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Described and .evaluated is the 1973-74 Hark Twain 
inte-nship Program, a aemonstkt4on project to train teachers of 
IJoJionailv disturbed adolescents who' experience learning and human 
ro?!i?Sns difficulties. It is ntft^ed that t^e program was sponsored by 
«i??go2ery ^oi.ty, Maryland p^lic -^^-f^l" JJ^.f? '^ff. ' 
under Title IV, Educal;ion of the Handicapped Act. Sections I anc ii 
cov^^ aspects ^uch as the program's history, goals and context and 
p?ov!de,an overview of program operations and management (including 
curriculum and staff development). Evaluated in Section I" 
^^t^inment of such program objectives a^ establishing a teacher 
oXnr«?Ton faculty for the Hark Twain center, formulating, intern 
se?ec^ion pfocedLes^ developing a competeney-based teacher training 
JnrriculSm and implpm^nting learning experiences for trainees in 
liie coipetency areas: psychoeducational assessment, hu*an relations. 
cu^iculSrde^elopment, behavior mana-j^ment, and systems ^jalysis. 
Se"ion iJ summarizes ^he report. Sippendixes include reports by an 
!nd;peSdent program auditor and by a curriculum review panel. (LH) 
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I. INTRODUCTION 



special needs 1»» c<»M to a dose. ^J' ^^^-^^^J^'fHf K School In the 

. staff Development Institute V"J?'f^l "fj; '^"cappe.! edolescents; it 
suns WWmlques needed to ""^.'^"''^'i^^i'LhSl »"« de»elop«nt . 
served- » ^-.^ f.it^«^r^ionJ problems, 

center for the ""J^jl.J^i^^'f^LS planning, grant from the U.S. Office of 

«lnafeitute was submitted to the granting authority in 197.. 

^ . 4.4 ^ of the Mark Twain Teacher Internship Progrpi was sub- 

A report on the initial y«« °f ^porrfocuses primarily on describing and 
aitted in March, l^^"^* JJf P'!^^^ J^cher kt^mship Program which began ^n » 
evaluating the ten-month Mark l^*'^"^!"^: . the final year of funding 

August. 1973. and ended J^^^' ^3^^^' J^^J^/^^%rJlandicapped Act. some review 
under Title IV of Public Law 91-230. Education ot tne /J972-73 Internship 

of the 1971-72 Mark Twain Staf ^^^J^P^fiJ^^fs^p^o^ year also are noted. 
Progr^ is included .^J^l^J^nf Ind imJIeLnting a public school 

IIZZ prg'rLtrTer^onTei ^o rcradofescents^ith^embtional and learning 
difficulties is examined and assessed. * 

"action I presents the history of --^am. U^^^^^^^^ " 
context within «hicbU operates. _^ect^^^^ ^^^^ ^^^^^ 

operations and management. Progress ^owara discussed in Section IH. includ- 

recommendations for ^he future are P'f f^J^^- p^'^a^'on staff development in 
i„g the i::^act of the Mark -^-^J^^J^^^^^^ ^^1 eSucatLn Section IV summarizes 
MCPS and elsewhere, both foif general and speciax eu 

the report. . . ' • 



HISTORICAL BACKGROUND 



other sct.001 systems- across the nation -^B-r, Jjunj^ rcc'ed'S'^i^dric 
become increasingly concerned 'Jf 3^°^". of facilities and trai»ed 

tasks and human rel."°-"P» £^,1^ hSe s^uS^ls are adolescents who a«e. over- 
personnel, to work 'J'^;,i"^''^hieve academically, to e»ercl4e proper Jodg- 
uhelmed by failure. They fall to " constructive activities, and to 

«nt, to organize their f""!"' f'' S^i^ contlnuSg "allurei Isolate them from- 
behave in socially acceptable "'ll' ""tout iesolution of these problems, 

their peers and alienate them f"»,»''''Jf?- community with poor vocational 

. large number of ''''"J'nLrrtr^g feeUng^ S l^SU a^d h^tillty. Many 
l-^JhS™ irrwrrrrr\:^ul"l:S;ranrbecoL a burden on the co^unity. 

in order to prevent this ..ate ^.'rZlTUl.Ts^^TlX'^^ -^^^ 
SrwXsp:rai"n:^3l'Tro~Te1hn^apment of strategies and the 



delineation of 'services uecessary to implement a comprehensive, countywide sup-, 
plementary education program, ^ grant was ^arded to Montgomery County Public 
Schools in 1966 under the Elementary and Secondary Education Act to study the 
feasibility of designing and operating a m#del. demonstration school for children^ 
whose special needs were not being met by existing school programs. One of two 
recommendations with highest priority was the development of r^ultilevel school 
programs for the Ji^aluation, education, and adjustment of emotionally handicapped 
adolescent\oys Jfd girls in three types of settings." These were to include a 
"year-round day program in a sp^fcial school for seriously handicapped adolescents, 
programs in selected junior and senior high schools for students able to function 
with appropriate support in the regular school environment, and a satellite school 
for mildly retarded adolescents who are emotionally handicapped (MCPS, 1967). 

Implementation of the first part of this recommendation was apiAroved by Montgomery 
County Public Schools; and the appointment of the supervisory staff of Mark Twain 
School was completed by September, 1970. At the same time, the second part of the 
recommendation wa5 implemented when Mark Twain School-Based Programs were 
launched on a pilot basis in three junior high schools. The Mark Twain Programs 
serve as a means of fulfilling a commitment toward implementation of the Montgomery 
County Continuum of Educatibnal Serviees, shown in Figure 1, which was adapted from 
a plan developed by the Maryland Department of Special Education, ^he continuum 
concept is a" plan to provide educational services to all children according to the 
degree of program specialisation needed -to meet the severity of the problem. 
Implementation of continuum programming requires the preparation of additional 
personnel with special training at- all levels of educational service. From the 
earliest planning for Mark Twain School ^J.ts rdle as a teacher education center 
was recognized and documented in its basic objectives. Toward this. end. in April, 
i:^71, f^ntgomery County Public Schools received a grarft under Title IV of Public 
Law 91-230, Education/of the Handicapped Act, to supplement funding of the Mayk , 
Twain Development Institute. Following that grant period (July 1, 1971, to 

June 30, 1972), a two-year continuation grant (FY 73 an^ FY 74) was awarded to 
develop the project a prototyp^e for continuing staff development, the Mirk 
Twair Teacher Internship Program. 

Now beginning its third year of operation, the Mark^a^" Teacher Internship Pro- 
gram helps fill the growing need at Mark Twain School and Mark Twain School-Based 
Programs, as well, as at other Montgomery County schools, for trained personnel to ■ 
w^rk with, adolescents who have special needs. 



FACILITIES 



Mark Twain Programs provide the setting for the Mark Twain Teacher Internship 
Program. The major portion of the training, including the seminars, takes place 
at Mark Twain School. Montgomery County schools which are sites for the Mark 
Twain School-Based Programs are used, along with Mark Twain School, for practicum 
experience. County and area special educatioh facilities, both public and private, 
are additional training resources. 



Mark Twain School 



Mark Twain School is one of five special schools in the Montgomery County public 
school system. Located on 22 acres in Rockville, Maryland, and constructed at a 
cost of $3.2 million, the school opened for students in February, 1972. To 
establish an educational environment with balanced groups of students lu Binall 



CONTIIWUM PROGRAMMING: 



aSlUEP^LINT for meeting EPUCATlONAL NEEDS 



7: S yeclallzed Facilities - 
jlie^'Scl 



Level 

Nonpublltf^'School 

Pupil needs more protective or more 
Intensive educatlonil setting than can 
be urovlded In public schools. (Day 
or residential program) ^ 

\Level 6: Special School 
PiipU receives prescribe program under the 
direction of a specially trained. staff In a 
specially designed facility within the public 
school system. (Mark Twain School) 

Level 5: Full-time Sneclal Cliass • 
Pupil. receives prescribed program under the direction ot 
,a special class teacher. - ' ^ 

Level 4: R egular Classroom a nd Resource Room r u - ' 

Pupil receives prescribed program under the direction of the regu 
lar classroom teacher; in addition, he spends time in a specially 
staffed and equipped resource room. (Mark Twain SchoolTBased 
Programs) . ?/ 

Level ^^'-^vr^-r n ;.ssroom with Supplementary Instruction and Service 
P^il r;c elves prescribed program unde r the direction of the regular c 
r*« teachert in addition, he" receives supplementary instruction or se 
iZ an itinerant or scho;i-base4 specialik. (Mark Twain School-Bas 
^ Programs) i , • t • ' , > 

Level 2: Regular Classroom w-ith. Consultation to.Teather 1 
Puril-iceivL prescribed program under the '^^"^^J- ° /^«^J^^,^^^rini;h 
.who is 8,upported,by ongoing consultation from specialists. CMark TWain Sch 

Programs) ' 

^:;?n;cel8r5fSTlogr^ under the direction o£ thS reguUr cla^sroo. t 



.CONTINUUM Programming: a blueprint for meeting educational needs 

^ Level 7: S peclal^ed Facilities - 
WoVi publlc gchool \/' ' 
- Pupil needs more protective or mor« 
* intensive educaUonal 'setting than can 
be provided in public ' s<»ool,s . (Day 
or residential prograjn) - 

Level 6: Special School 

Pupil receives prescribed i^rogram «nder the 
direction .of a spe«;laUy trained staff- in a 
'Jecially designed facility vl.thin the public 
' school systei. (Mark Twain- School) ^ 

zt — - """"" 

a special class teacher. 
I'-el A: Mguiaraa ,sroo.%nd R^ 

Pupil receives prescribed PJ°f"" ""Jf 3'^^d3'time in a specially 
lar classroom teacher; In addition, he^Pends ^ School-Based 
Staffed and equipped resource room. (Mark ivain a 
Programs) 

Pupll, receive, prescribed ^'^^^^^J^^J J^'^.^T'^; infraction or, service 
\Z riSr»t1f ^c^^l-baHd special'i^e. (Mar. Twain S6hool-Based 
Programs) ^ 

1 2: -rr'" ri..-roo. with C ^"""' '° Jj'f „galar classroom teacher 
L":;rorterrorinrr:uaflLl:rsre" ^Mar. Twain SCool-.ased 

rams) 

.SThSfffif^ogra..onder the direction of the regular classroo. teachei. 




'J 



llu Grade: "-9. with 12 teachers and 2 tea. leaders. The upper -ho°l c-f^sts 
if 50 students, aged lA-18. Grades 9-12. with 6 teachers.and 1 team leader. At 
maxiAum enrollment, approximately 250 students can be serveH. 

The malor objective of M^rk 'iwain School is to provide. an individualized educa- 
^Jon^ p^ogra^ for preadolescents and adolescents of at least average intellectual 
Jirential Sho display problems in the area of hun^an "1^"°-^ f,;^ ^3 
organization, or Vehavi«,i;aiy-linked learning problems. The ultimate 8°jl " 
promote student return and successful functioning in a regular ^^^ool within a 
^idmum of 2 years. Scholastic skills are developed through 
^friculum, highly individualized to meet the specific ne^ds of each ^^udent 
Students' Strengths and weaknesses are identified by perceptual, cognitive, and 
af?ec?Jve ^s^sfme^t^d the results used for progranoing and instruction. The 
intent of instructional program is to remediate deficiencies while maintaining 
fcadeMc p ogres At the, sLe'time, eii^phasis is placed on the development o 
lllrlTr J^e Lhaviors for positive interaction ^^th peers and^dults. Each s u^ 
dent is assigned^to a teacher/advisor who counsels him and serves as his iia 
..with other staff members. 

Three-seminar roo.^ were deel*ned for tielning purposes when '"^ f^''^ 
li^rpotentially ,«llable for training are " f-'J""-;^^ Jf^jJ^^ 
i^K« -^7 offices 6 conference rooms, and 1 observation room, me 
i^^oirc^^slerr: av^ila^le to trainees contains a pri^t J---^ -;f;,,,,,3. 

Sirrsych2trist,'soci£ workers, nurse, medical advisor, and researchers, in 
addition to teaching and| staff development personnel. 

Mark Twain School-Based Progtams 

Mark Twain. school-Based Programs were operating during the "J^'* 

^kr^u'X:z :i;ri;;;L:r a3''^fho:j^i;'i9n-irrn; tt^fp 

and 2 middle schools. They P 1975-76. These programs serve as practicum 

^T. '"^o "?h:"r"ne;s Schoof-ba ed re ource teachers'provide support to regular 
: L'sroom t^acSrs Td'stLents by assessing academic and social difficulties and 

i;^^^^ SJeSg-LfesP^^^^^ 
;ith th^ res^urS Lam and with the regular classroom teachers to utilize the 
resources of the school where the program is based. 

ConmUnity Resiurces 

' «„Ko. of oublic and private facilities providing specialized educational, 

Cn VZTll IVZT.AIJ.T.V:,1 S:ir;rrgrl"»f facilities, in addition 



tiona participating ift the comunity resources program for interns and 
during 1973-74 a^ listed below: 

. Boys Home of^toht^mery' County, Silver Spring, Maryland . < 
Community AffairrWce, MCPD, Rockville, Maryland 
Karma House, Rackvill^teryland 

Maryland ^ y 

may have impact on MOPS decisions. , t. 
Other Resources . ^ 

county Public Schools, are avUlable to trainees. 
PROGRAM EVALUATION ^ 

The purposes of the evaluation of the' Mark TVain Teacher Internship Program are to 
' provide appropriate and timely information: 

( 1 During the year so that revisions in the program.can be based, on this 

eiJJence and implemented as feasible -(formative evaluation) 

2 At the end of each year and/or major sequence so that Judgments can be 
of the prototype program (summative evaluation) 

"Sr^roWe^ in liv^n^" 'a/such! the progra.' a.tlcipate» .everal- 
additional results: 

1. *„tgo«;, county ^ -";\'j:^nr«'°e:^fiorarirw"app.d 

implement its continuum ot educational services co em 
children. 



2. The program^ will serve as a prototype for others with similar needs. 

3. The prototype will be an innovative cdmpetencybased model for preparing 
^ te,acherd to work effectively with children and staff. 

The purposes and* goals ot the project as presented in the objectives section of 
the grant proposal were reviewed to develop clear statements of '^he scjpe o the 
evaluation. This resuUed in a restatement of the program go-ls and objectives 
and In a set of evaluation objectives to, fomf the. basis for conimunication and 
action. Table 1 shows the program and evaluation goals and objectives. 

Evidence acceptable to the program staff ajp well as the activities tasks 
required to obtain it were identified for each evaluation objective. The state 
ment that this program is following a compeiancy -based model however has grown 
" in 8ignifican<ic since the original proposal. As a result, the current evaluation 
report addresses some criteria (such as thotfe suggested by Rosner, 1972) which 
IJre not clearly developed at the time of specification of progr^im and evaluation 
goals and objectives. " - 

The fevaluation personnel are members of the Mark Twain Sphool staff. Because of 
this Circumstance, an independent educational accomplishments audit (an external 
evaluation designed to assess the appropriateness of evaluation Procedures both 
design and Implementation) was contracted with Dr. Malcolm P"^?' 
EvalStion Research Center, University of Virginia. A «^P^"^^ ♦^"f , 
found Appendix A, was submitted to the funding agency and to the local school 



system 



aA evaluation of the competency-based curriculum concent and delivery was made by 
a panel or recognized experts, independent of the program and its °P"f-^°"^'-J_ 
during a two-day on-site visit in August, 1974. The visit is described and dis 
cussed in Section III. The panel's report can be found in Appendix D. 



II. PROGRAM DESCRIPTION 

The previous section introduced the Mark Tviain Teacher Internship Program, Us ^ 
goals and objectives, and the context within which.it was created and oP^ates. 
This section presents a description of program operations in relation to the^o 
gr^ objectives, a^^shown in Table 1. Funding and budget for the two-year period 
of the federal grant. FY 73-74, also is reviewed. 

ESTABLISHMENT OF A TEACHER-EDUCATION FACULTY 

The emphasis in. the Mark Twain Teacher Internship program is on a competency^based 
modelTith integration- of academic instruction and j^r^cticum ^'^"i^^^^^^'^^^^^^^^^ 
strategy for program staffing also revolves around the concept of competency areas. 
J^i^rSch of fi5e basic competency veas Is coordinated by a mpmber or members of 
Sr^rklwain Programs staff. Each competency area coordinator has^^sponsibility « 
■ and authority for developing and arranging the implementation of learning experi- 
Sees in his'basic competency area, in consultation with the planning staff and 
the training director. The role of competency area coordinator is intended to 
^sure staff "responsiveness to the needs and reactions of trainees and to provide 



TABLE 1 

Program and Evaluation Goals and Object 



Progrf 



Evaluation 



a; To establish Mark Twain School as a 
Icialized staff develeptaent center for 
i preparation and continuing development 
iersonhel to work in educational programs 
rving preadolescents and adolescents 



fective 1 . To identify and establish a 
Icher-education faculty for the Mark 
iin teacher-development center 

iiective 2 . To develop processes and 
kedures for recruitment and selection 
[teacher interns 

lective 3 > To develop a competency- 
Ud teacher-education curriculum 

lective 4 « To implement the learning 
beriences and activities that will 
Lure participant attainment of coinr- 
kency in each of the following areas: 

Psychoeducational assessment and 
programming '^-4 

Human relations and counseling 

» 

Curriculumt^evelopment and 
Implementation 

Behavior management ' 
Systems analysis and consultatio;» 

le ttive 5 . To develop a functional 
rtem and methodology for evaluating 
bwledge, attitudes, and skills in 
specific teacher competency areas 

iiective 6 . To incteat-e the 'number of 
bined personnel serving emotionally 
fid i capp h 11 dr en 



Goal: To establish evaluation procedures to 
irovide appropriate and timely information 
during the formative stages of the project 
for program feedback and modification as 
well as to determine overall project 
effectiveness 



Objective 1 . To assess faculty qualifications 
to determine if they are sufficien^f for 
performing required fuihitions am/ duties 

Objective 2 . To assess tKis-eftectiveness 
and feasibility 6f the recruitment and 
selection processes ^ 

O bjective 3 . To assess' the adequacy of the 
oulticompetency-based teacher-development 
curriculum for its comprehensiveness and 
internal consistency 

O bjective A . To assess each participant 
completing the training program for his 
competency in each of the following areas: 

a) Psychoeducational assessment and 
programming 

b) Human relations and counseling. 

. c) Curriculum development and 

implementation , 

d) Behavior management 

e) Systems analysis ^d consultation 

Objective 5 . To assess competency assessment 
techniques for validity, reliability, v 
examinee appropriateness, and administrative 
feasibility 

Objective 6 . To determine if P«"°""^J^^,. • 
coiplet l^^the tratnlitg program are effectively 
serving emotionally handicapped children 
and are utilizing learned competencies 



for consistency and direction in meeting program J 
iSstructora. cLsultants. and guest lecturers make f •i'»P°'^^ " 
the overall program, the nature and thrust 6f the ftducatioual^ program is deter-, 
iined by the Mark T^ain Programs- staff. The Mark Twain Programs staff assumes 
the major share of actual instruction and all of the practicum super/ision of 
interns . / 

Figure 2 presents- the continuum model used for defining levels of staff relpon- 
sibility in the Mark Twain Teacher Internship Program. There are currently about 
80 professional staff within the Mark Twain Programs, of whom apptoximateiy jO 
^have participated actively in the operation of the internship program. 

Level 1 responsibility (general support) is the minimal eKpectation of all school 
faculty. Level 2 responsibility (practicum supervision) is. arrived^at Jhrough 
the mutual desire of M^rk TWain Programs staff and the internship administration 
Zd is exercised within the regular professional york day. /^^^^^^^J,"^^"^^! 
Hark Twain Scfiool staff and 15 School-Based personnel served as practicum super 
Ssors! Lvels 3. A. and 5 responsibilities (Academic Instruction and Competency 
Area Planning and 'Coordination) are optional (for staff) and require an informal 
^ntracSLr Agreement between the internship pfogram administtator and the inter- 
ested staff -ember. Levels 3, A. and 5 fa^zulty positions are paid appointments 
under a second job title of "In-Service Consultant." Appointments are made on 
^Sf Uis of aviilability. commitment to training, and expertise in ^he relevant 
competency area. During the 1973-7A Internship Program, ten of ^he Mark Twain 
School staff and ten of the School-Based Programs staff were appointed as in- 
'service consultants. Level A. which was conceived as an advisory level, is 
cu^^ently ac^iie only informally; many of its functions have been subsumed by an 
enlarged Level 5. ^ 

in addition to the faculty of Mark TVain Programs » training support was provided 
ly Sontgo^ry County Public Schools resource staff and outside consultants who 
were called in for presentations in their special fields. 

The 1973-75 staff for the Mark Twain Teacher Internship Program is shown in 
Appendix B. 

RECRUITMENT AND SELECTION OF INTERNS 

The Mark Tvain Teacher Intem4ip Program of 1973- 7A had a total of eight parti- 
cipants, who were selected from among 27 applicants. The group included five 
woS^lid chree men. Three were working toward graduate degrees at T^^f ^^Jj^^ 
In the area. Ail had at least two years of classroom teaching experience. Six 
Tf tie eU? interns were teaching in Montgomery County Public Schools P^ior to 
«^try int! the program. The school system allows teachers who have worked in the 
schools tot seven or more years to take one year of academic leave with 50 to 60 
per cent of their annual salary, depending upon whether they agree to continue in , 
SSs for two or three years. However, due to the pressing needs for highly com- 
• mitted. well-trained teachers of unsuccessful students, thA school system 

authorized a policy enabling tenured Montgv»ery ^"^^^^ J^f.^^.f °o 
six years of experience to be granted "UmiSual and In^jer^tiye (U and I leave to 
participate in the program. Teachers selected for U and I leave were^also pro- 
vided 50 to 60 per cent of their salaries. The two part icipants^ who had not 
pievLusir taught in Montgomery County received no salary. Selected characteristics 
of interns are listed in Table 2. 
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Level 6. ^rojgram Direct i on; Planning, 
developing, and managing processes and 
resources for Implfeisentatlon of total 
program. 

.Levtei 5. Coinpetencv Area Coordination : Planning, 
developing staff and loedia resources for Implementa- 
tion, and evaluating ^iompctency-based curriculuB^* 
Instructing as arranged. ' » 

» 

Level 4. Competency Area Planniug ; Assisting coopetency are 
coordinator(s) in planning and developing staff and media res 
for implement at ion and evaluating of competency- based currlc 
Instructing ^s arranged. 

Level 3. Academic Instruction : Instructing one or more seminar s 
in coordination with competency area coordinator, outside of regal 
assignment. 

/ ^ 

Level 2. Practieum Supervision ; Directing, guiding, supervising, an» 
practicum^ teaching activities within the reg-iiar assignment. 

Level 1. General Support ; Cooperation, facilitation, and sharing of ideas 
with interns and faculty within the regular assignment. ^ > 

s. 




^ ♦ 



J 



s 




Level 6* Program Direction : Planning, 
<// developing, and managing processes and 
resources for implementation of total 
program. ^ 

Lev^l 5. Competency Area Coordination : Planning, 
developing staff and media resources for implementa- 
tion, and evaluatin<^ompetency-based curriculum. 
Instructing as ^arranged. 



Level 4. Compec^acv Area Planning : Assisting competency area ^ 
cpordlnator(s) in planning and developing staff and media resources^ 
for implementation and evaluating of competency-based curriculum. 
Instructing as arranged. " ^ 

;Level 3.. Academic Ins t rue t te n : I\istructing one or more seminar sessions » 
ir coordination with competency area coordinator, outside of regular 
assignment. 

Level 2. Practicum Supervision : Directing, guiding, supervising, and evaluating 
practicum teaching activities wiihic the regular assignment. 

1. General Support : Cooperation, facilitation, and sharing of ideas and resources 
interns and faculty within the regular assigOiOent:. 




5:r.i°.r' Ih'Jio^ Lr s w « LngneTto provide relevant data from multiple ■ 

rrSeSiSSl^^' ^ weeUy publication Join, ^^^^l>^^' ■ 

^iu orientation sessions tor interested persons, held at Mark Twain and 
aeUted otrer^dtgo^ery County public schools; and (c) dissemination of basic 
, information and reference material about the program. ^ 

The selection process consisted of two phases. Phase I was a review by a Selec- 
tion Conmittee of four sources of data on applicants: 

i. A summary of the applicant's MCPS personnel folder ^ 
• 2. Mark Twain Supplementary Application Form 

3. Personal references obtained by telephone or mail 

4. Group interview 

Group (Level 5 staff), the Mark ivain »^ v ^ ^ Staff Development, 

Based Programs, ^-/-P^^^^^^^^^Sg ^pmLnf of p'rofef^^^^^ Personnel. Those 

potential for successful future services. Six MCPS teachers ana two 
teachers were selected from among 27 applicants. 

Recruitn^nt and selection of interns for the ^^^^^-^^^^^l^:^^^^^^ 

197A. and followed the, same rigorous P^/^f-^^',/, ^^J/.^e^J^reS to contact a 

Bulletin that applications were ^eing accepted * a ^^^"^^^^^J^^^^^.^^ehool-'based 

^^LJrrsTe-TvLr^^^^^^ - V r-f r ri^ut^r^ 

Jt S^rk iJaJn fJioSl ^d three to the faculties at other county schools were 
conducted by program staff assisted by current interns. 

Characteristics of 10 interns selected from among 25 applicants are found in Table 
2. 

CURRICULUM DEVELOPMENT 

The curriculum for the Mark Twain Teacher I .ternship Program is based ^en- 
I^ntr fuU-^Le learning experience. Thi. curriculum consists of an integrated 
Tchedile of :^inarrpractica. and individual project., organized around the 
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TABLE 2 

Selected Characteristics of Mark Twain Teacher Interns 



Characteristic / 


I 

1972-73 


ntemshio' Year- 


197A-75-'- 

• 


1 Over 40 


1 


0 
A 


0 
A 


1 31 - 40 ' 


1 


A 
H 


6 


1 30 and Under 


6 








2 


3 


2 


1 Male 




5 


8 


|\ Female 


6 






1 

■cation 


3 


5 


A - 


■ \ Bacnelor s uegree 




0- 


• 2 


■ ^Master s Degree 2 


1 




A 


1 paster s Degree m progress 


A 






1 -^^ ^"^""i^ * ' " 

LsrooiD Teaching Experience 


2 


A 

2 


2 


■ 7 years or more 


S 


6 


8 


I 2-6 years 


0 


0 


0 


1 Less than 2 years 


1 


0 


d 


1 None 
I 








Irs in MCPS 


0 


2 


2 


1 7 years or more 


6 


4 


6 


I 2-6 years 


0 


0 


1 


1 Less than 2 years 


2 


2 


1 


I None 








Ivlous Assignment 


2 


3 


7 


1 Secondary School Teacher 




4 


3 


I Elementary School Teacher 


5 
1 


1 


0 


1 Nonte^ching 









2 'JS^iJf/iZL stud, in a d.gr-c^ progra„. Doe, not Include nondegree 
or In-servlce course work. 
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* , ■ .. • - 

developnent of trainee competence in\ f ive basic arsa^. Competency coord ina-.^ 

to« a?e responsible for continuous refinement of co^tencies and identification 
of performance and behavioral objectives relevant to each. The presently defined 
15 coBpetencies and their related performance and behavioral objectives are found 
in Appendix, C. A brief description of the five basic competency learning areas 
Including examples of compeVencies . performance objectives and topics covered ^ 
follow: 0r . r * *. 

^ 1. Psychoeducational Assessment and^ Programming 

V IVo competencies specified for this area relate to (a) the ability to 

complete a psychoeducational profile and (b) use of profiles in planning 
programs for individual students. Performance objectives for the first 
competency involve the ability to administer and interpret^ assessment 
instruments in the affective, perceptya^, cognitive, and educational 
domains an<i to integrate data from these instruments into a valid psycRo- 
educational profile. Curriculum modules cover the following topics: 
extracting and categorizing data from pupil cumulative records; nature of 
- intelligence; inclicators of intelligenqe, achievement, ^d aptitude; cog- 
nitive development and classification of iskills i\the cognitive domain; 
perceptual development and assessment; assessment df specific learning 
disabilit'ies; techniques for teaching children with specific learning 
disabilities; assessment of learning styles and human relationships; and 
planning student program adjustments. 

2. Human Relations and Counseling 

The three competencies in this area include (a) the ability to comprehend 
and communicate effectively in an educational setting; (b) the ability to 
interact with empathy, respect, specificity, self-awareness, fd «elf- 
acceptance in an educational setting; and (c) the ability to facilitate 
, attainment of humanistic educational objectives in groups. -.An example of 
a related performance objective is the demonstration of abiTrity to com- 
prehend communications, in terms of content^ and feelings, with students 
and peers, in a counseling interaction. Curriculum modules cover the 
following topics: counseling and helping; definition, objectives, ard 
processes; listening for content and feeling; interacting with respect; 
interacting with empathy; interacting with specificity; integrating basic 
counseling skills; giving and receiving feedj)ack; self-acceptance and ^ 
' ' sending "l Messages'" Jife space analysis and working towards resolution, 
'and planning for group counseling: objtctives. leadership, format, and 
activities. ' ^ 

0. Curriculum Development .^nd Implementatioa* 

Four competencies are specified in this area. These are (a), the ability 
to plan and organize an instructional system, (b) the development and 
selection of appropriate curricula for special students, (c) the planning 
and implementation of appropriate learning activities and teaching strate- 
aies and (d) the selection and development of appropriate resource 
Lterials. One performance objective specified is the demonstration of 
ability to integrate strategies from various sources into a curriculum 
apjrojiiate to students. Curriculum modules include the following topics; 
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strategies for promoting individualization of instruction; el°Pi"8 
^ . oMecSvfes to meet affeAive, cognitive, and educational needs; teaching 
smis through high interest topics -^"^f ' .^^t^^^^J^^.teS-- 
•and evaluation <^t cominercially prepared materials and audio-visual tech 

nology and materials. 
4. Behavior Management I ^ , 

ThP followinz. three competencies are defined: (a) the ability to estab- 
Sah Jid ^inforce beh^iT>ral valu^. expectations, and limits i" an 
• tduca'onS setting; (b) the ability to i<»-;ify 

o«n<nff with conflict and frustration in an education^ setting, and 
tS aSilu^ to deveLrand use teacher-^intervention techniques to manage 
Sfectitely disr^jfiv' school behavior. A related performance ob ective 
is the application of operant, surface-management and lif-«P*«^^f 
viewing principles in problem situatiops. Curriculum modules <=°ver 
S^tify?ng and meeting the needs of children with emotional ^nd learning 
nroSieal- Alternative approaches to educating children with special needs. 
Sariringlehl'or valS's and limits; strategies for ^^f f i^,^^!"" 
viluea- strategies for coping with frustration and conflict; and inter- 
"itio; tlc^iques for disruptive behavior: surface manag.ement. life- ^ 
space interviewing, and operant procedures. 

5. Systems Analysis and Consultation 

- The three competencies for this area relate to (a) ability through toowl- 

Soe of svstSs theory to understand and analyze the operation of the 

edge or sy»teius u^cw*/ «„«».^,«o. (y^\ Abllltv to use skill 

c^veraiiJJzJng school operations, ^understanding family and community 
'Skills." 

4 A ^A^r. ,'nrr^culllm modules which include objectives, 
instruction i^y participants. 

curricula development was a major goal "^/,^^;',^j2r'rnt;ri'sM; ?^ogram 
independent review of the '^""i^"!"'" ° V^L^Mo^ s'Seciareducation.. and 
was made. A panel of experts on general ^^""^J^^^^^^^^Jfi Jj^n with the program, 
competency-based teacher eauca ion. ^ ^^^^^ to assess content 

conducted a t-o-d&y on-site ^i^ij. The P" P program objectives. Prior to 

TrJ lv:i:Te visU. panel „e„.e.3 . 



«et individually and in groups with program staff, participants. 8"d"»;^«' f"** ... 
^Ssi^ir (principals J pupils). The panel's report appears " Appendix D 
Secific comments and reco»nendations are^ presented in Section III with the • 
objectives to Which they apply. ^ <^ . 

» LEARNING EXPERIENCES AND ACTIVITIES \ ' ' 

The 1*73-74 Mark Tyain Internship Program provided ^^l-"«^\J"f ^^^J" 
>7S three-hoor seminar sessions ^nd 30 weeks of practice teaching in both Mark 

Twain School arid School-Based Programs. The 10-month learning experience began in 

uJ^ A^i^t. S73:^d end.ed in iLe June. 1974 Learning components were varied , 
.'i; prS^alanc; in the .internship experience and included: a) seminars. (2) 

practica. (3) individual projects, and (4) a human relations group. , 

1. Seminars 

«:«.<nars are the basic elements for competency-based instruction in the Mark 
l^fnTearerTnte^ship Program. Seminars were ^on^^lll^'l^^^^^^^ 
area under the direction of the competency area coordinator and involved 15 
llTeeZo" group sessions. . Each seminiy; session usually was structured to 
include content and activities to proibote Specified knowledge and skills and 
to review progress on related practlcum activities. 

2. Practica 

Practicum experiences are supervised applied learning situations in which the 
^n^!rn oarticioates directly in activities that are real samples of profes- 
So^aJ 'role fiJctiL S responsibility, including teaching students and pro- 
viding resource services to staff. 

T„^or„« were reauired to complete 900 hours of supervised teaching in Mark 
iS^in Sch^o TdTrk Lin Lhool-Based Programs. During the first o three 
Sacking practica. the 1973-74 interns were placed in Mark Twain School for 
seven weeL. During the s'econd cycle, they spent seven "^^^s .in Mark Twain 
School-S^d Programs placement^. The third cycle, occurring after seminar 
iStric'ron had coHuLd. was a full-time 16-week practice teaching experi- 
ence wfth location arranged on the basis of individual interest and specific 
training needs. 

nnrlntt oractice teaching cycles, the intern was assigned to a particular 
teaching te^! wUh one meJiber of that team identified as the primary super- 
^^oi. lie intern and his supervisor sought to develop ^^J^^^^.P^^^J^^^i^^^, 
Slectives and met regularly to discuss progress and issues related to those 
objectives. Progress has been made on identifying goals and «P«<=t-'^i°"^ 
witMn each practicum placement site and relating , them to competency area 
objectives. 

3. Individual Projects 

Interns were expected to pursue at least two areas or units of study that were 
oarticularlv suited to personal needs and interests. Elective projects were 
o?feied in each competency area as well as in a cross-competency area relating 
to issues in sJeciS educLion and analysis of teaching. Most projects were 
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* developed for application to actual teaching r^es. ^"^^^"'J^^P"^^^^^"",^. 

tielAtemship! Eac^ project involved approximately 30 hours of work and 
re uUed i^ tL award of Le in-service credit upon -^/^^ ^^^^ "/jif^J""^, 
Interns could elect to carry out a single more extended project for which two 
credUs we^e awarded. Table 3 lists the projects completed during 1973-7A. 

A. Hunmn Relations Group 

All interns participated in a small self-study group with a trained group 

Siing r providing feedback, listening and consulting, transition and 
separation, ano confronting limits and expectations. 

TK in mar^th traininR period was divided into seven learning sequences, as can be 
?;Tlirr3 ?^e sequences are desl^gned to keep pace with interns' develop- 
'^^■^.t nllSa e ; bLinSng with understanding general approaches to helping 
roi:wf ;nr?;dinrilth Lsummg responsibility for providing specialized 
services to students and teachers. 

r:efrce::c;:ji:re "Zl^lT^lll. ..sU^^n... participate in pro- 
gram and self- evaluation. 

DEVELOPMENT OF COMPETENCY EVALUATION METHODOLOGY 

of orocedures both formal and informal, were used to assess intern 
A variety of procedures. ""J" . presented as part of seminar 

attainment of competency, y*^"^^^"^ ^^^^^ ""%^view and evaluation periods. 

ntultlple opportunities to improve P"f°™f^" ""J^^^^^nbLr^atLns . were used 

■^^ii^s rating. ^l^^^'^/r^i^^f,^^;^:!^,:^ en^o^^^^^^ character- 
which the intern °^ff m positjve interpersonal relations, and (3) 

Oevelopment of a functional system of evaluating the .f^^^^ Pro^-m 
includes determination of (1) a P""'^""/",^"'^^"""? „e .urement Instruments 

-rrtf^rp-r;.^^ rt^^^f ^tr; :ttai..t. . a.itio„ 

To (4) measuring attainment of competencies by interns. 
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TABLE 3 



Individual Projects Completed by Mark Twain Teacher Interns, 


1973-74 1 


Title 


Related Competency 
Area 


Credits 1 
Earned 1 


hfultisensory, Multit^nit Self-Instructional 
Spelling Curriculum 


Psychoeducationsi 
Assessment 


2 1 


Typing Curriculum to Improve Reading and Spelling 


Psychoeducational 
Assessment 


1 1 


One Week Mini-Units for Teaching Single Concepts 


Curriculum 
Development 


1 1 


Resource Unit for Social Studies Instruction 
on the Yukon/Resource Unit to Tep.ch Spelling 
Through Co.ding ^Hand AipnaDec oi tne ueai:^ 


Curriculum <t. 
Development 


1 


Ffultimedia Display of the Sen-ices of a 
Student Resource Center 


Systems Analysis 


2 


Planning and Implementing Group Counseling in 
School 


Human Relations 
ana L»ouubexi.iig 


1 


Life Space Interviewing for Curriculum 
Improvement 


Behavior Management 


1 


Planning and Implementing In--Service Course 
Instruction 


Curriculum 
Development 


: 2 


Planning and Implementing In--Service Course 
Instruction 


Psychoeducational 
Assessment 


2 


Construction of Innovative Math Instruction 
Games 


Curriculum 
Development 


2 


Drama Project to Promote Parent/Student 
Communication 


Systems Analysis 


1 


Guide for Five-Day Summer Workshop for New 
School-Based Programs Staff 


Systems Analysis 


1 
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First Sequence 
(3 weeks) 

Orientation to Mark .Twain 
School and School-Based 
Programs 

Seminars • 
Baseline Evaluation 

Orientation to Community 
Resources (1974-75) 



July I August r 



September 



Second Sequence 
\ (7 weeks) 

\ 

\ 

Pt-actice Teaching #1 

(2 full days plus. 3 half 

days, 26 hours per week) 

Seminars (3 per week) 



Third Sequence 
(3 weeks) 

Review and Evaluatic 

Visits to Coim&unity 
Resources (1974-75) 

Seminars (4 per week 



October 



November 



Fifth Sequence 
(2 weeks) 

Review and Evaluation 

Seminars (4 per week) 

Orientation to Individual 
Projects (1974-75) 



January 



Sixth Sequence 
(16 weeks) 

Practice Teaching #3 (5 days, 37 hours) 

Individual Projects 

Seminars (1 or 2 per week) ending in 
February ^ 

V 

A 

C 

A 

T 

I 

0 

N 



February | March I April 



May 



Sej 

Complet: 

Review 

Posttes 



Fig. 3. Mark Twain Teacher Internship Program Schedule, 1973-75 



It Sequence 
i veeks) 

Lon to Mark Twalti 
id School-Based 



Evaluation 

LoQ to Community 
(1974-75) 



September 



squeace 
ftks) 

Evaluation 

per week) 

to Individual 
L974-75) 



Second Sequence 
^ (7 weeks) 

Practice Teaching #1 

(2 full days plus 3 half 

days, 26 hours per week) 

Seminars (3 per week) 



October 



# Third Sequence 
(3 weeks) 

Review and Evaluation 

Visits to Community 
Resburces (1974-75) 

Seminars (4 per week) 



November 



Fourth Sequence 
(7 weeks) 

Practice Teaching #2 
(2 full days plus 3 hall 
days, 26 hours per weeklj 

Seminars (3 per week) 

V 
A 

C 

T 
I 

N 



December^ January 



Sixth Sequence 
(16 weeks) 

Practice Teaching #3 (5 days, 37 hours) 
Individual Projects 

Seminars (1 or 2 per week) ending in 
February 

V 
A 
C 
A 
T 
I 
0 
N 



February | March I April I May 



Seventh Sequence 
(3 week$) 

Completion of Requirements 

Review and Evaluation 

Posttesting 



June 



4^ 



3. 



Mark Twain Teacher Wternship Program Schedule, 1973-75 
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Events were monitored during the year, resulting in ^°"^inual modification of 
schedules, instructional format, ^and requirements. Feedback slips turned in by 
participants at the end of each seminar session provided information on the cpn- 
?ent. pacing, and relevance of the session. More detailed feedback was excited 
at the last seminar session and during three review and evaluation periods. This, 
feedback was used in confcerences between individual interns and the program 
director and for interaction sessions with interns anjj, program management staff. 
Discrepancies between stated or desired objectives and actUal practices were 
identified^ with action reconnended to reduce them. Throujshout tne year an intern 
representative was present at the weekly meetings of Irt^evel 5 management staff. 
As an example of program modifications resulting from participant feedback, two- 
credit elective projects wwe instituted when it became evident, that the great 
amount of effort involved^and the lasting value of ^om^ of the projects was far in 
excess of what was initially anticipated. To establish a ^ 

evaluating intern performance during practice, the interns (with the help of the 
program director) compiled a list of competency-related activities; this li" has 
. been adopted as an illustrative guide to the kinds of classroom behaviors that 
would indicate competencies.. A program of orientatioti to community resources ?or 
teachers and visits to nearby facilities is being reemphasiz^d as the result of / 
strong expressions of thrf usefulness of these activities by former interns. 

Progress'was made on the development of teacher-«ade tests of competence Sorie 
specific task was required, as a demonstration of either skill or knowledge, for 
most of the stated performance objectives. Discrimination of graded learning^ 
activities from ak-^essment tasks was emphasized.' Instruments deve^dped during 
the 1972-73 year were evaluated (MCPS, 1974). Because the report was not completed 
'prior to the 1973-74 program year, results of the formal evaluation could not be 
used fully in modifications; they are expected to have a greater influence on 
instrumentation used for 1974-75. Significant progress was made in the inst^itu- 
Uon of measurement of some specific teaching behaviors under actual classroom 
conditions in practicum for validation of related performance objectives. The 
development of independent validation at the competency level of related " ' 
instructor-made performance objective criteria did not progress as far as desired, 
it remains an evaluation goal to be implemented as feasible. 

During the 1972-73 internship year; instruments were developed to test the- 
validity of the program and Ico relevance to the performance of various roles in 
^he teaching of kdolescents with special needs. These include: 1) a "itique of 
the instructional .program by the interns (Appendix F) , 2) a critique of the 
reLv^ce of training and effectiveness of use of program competencies by graduates 
who have been employed for more than a year in Mark Twain Programs, . and 3) a 
critique of the relevance of program competency objectives and graduates on-the- 
job effectiveness by their supervisbrs (Appendix G) . I" addition pre- and posfc- 
iutemship inventories provided indications of group shifts in values and attitudes 
toward adolescents, student behaviors, teaching, and self. These instruments were 
used in 1972-73 and, with some modifications, will be used again in 1974-75 as 
continuing docuoeixtat^n of program validity. They are described in Appendix H. 

Assessment of progress toward meeting program goals has been directed , to date, by 
the Evaluation Plan of 1972-74; a revision of the plan will be completed in 
1974-75 to address goal development. The design and implementation of program 
evaluation for 1972-73 was subjected to an independent audit; '^«P>'^'":''/^"/^f " 
tributed to the funding agency and to MGPS by the auditor. It was judged ^o be 
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"both comprehensive and internally con^stent" and 'irepresenting a hi^ water 
mark in the evaluation of a ^schooirbagfed staff training program." The following 
areas were noted as needing attention: increasing the usefulness of ongoing 
process information to staff; delin^Stion of staff functions for assessing faculty 
-irerformance; and implementation of the changes in program which are implied by 
evaluation. The audit concluded with the comment that "it qualifies along with a 
very few competency-based programs in the country as a rigorous and determined 
effort to both meapure and improve a teacher training program. The entire audit 
report appears in Appendix A. 

STAFF CEVELdPMENT ^ 

inherent in the concept of the Mark Twain Program^ is the 

growth and progress hlngep upbn the skill, sensitivity, and flexibility of the 
faculty. Service to pupils is thus seen as inseparable from staff development. 
The ultimate goal dfefche Mark Twain Teacher Internship Program is to develop open, 
mutually supportive^^esilient, effectively coping edubators who can, through 
words and actions, truly sustain a "humani;%tng educational environment both for 
themselves and their sti«ients . 7 . / I 



The Staff Development Program began with a six-month institute for the staff of the 
Srk Twain School from July 1. 1971. to January lA, ^^2. This institute provided 
a base froA which Mark Twain is expanding its continuing education mission for 
educational personnel throughout the school system as well as for its own staff. 
Of the 38 participants in the 1971-72 institute, 37 tecame the staff who opened 
the Mark iSain School, 32 of whom were still employed ^ Mark TVain ^OB'^"* 
1973- 7A. Seven of the eight 1972-73 interns areuemployed either in Mark Twain 
School or li» School-Based Programs. Of the eigk 1973-74 internship graduates, 
s2^^ have accepted positions in Mark Twain Programs, three in Mark Twain School. 
Ld four as SRT's ii» school-based programs. The eighth graduate has accepted a 
position to, teach first and second grade children with l^^^jJ^SZ-f ^ 
Lgular MCPS 'elementary school.- Mark TVain Teacher ^^^^'^^^^^P ^"^^f,:" 8"t^J^^3 
are now employed across multilevels of the MCPS continuum of educational services. 
Also of note, of the 80 professional staff within Mark Twain School and Sqhoo.- 
Based Programs, almost 50 participated in internship program instruction. 

Montgomery County Public Schools, through the State of Maryland, has approved the 
Xr^ for the awarding of in-service credits toward professional development 
sala^improvement, and additional certification in special education for origin- 
SlHeSfled teachers. In 1973-74. 15 in-service credits of instruction were 
offered to interns through seminar courses. Fourteen i^-^^i^^^J'^J^^.;'"^. „ , 
awarded for completion of practice teaching (900 hours) in both Mark TWain School 
2^d SchooJ-BaseS Programs. One- or two-credit individua projects -d the one- 
Sedit human relations group brought the core competency-based curriculum to 32 
in-service credits as shovm on Table 4. 

*The seminar courses, each .carrying three in-service credits, were opened as indi- 
viduarin-service c^.-rses during ?he fall semester to Mark Twain Programs faculty 
Sd in the Sring semester, to other interested MCPS staff. Total enrollment in . 
S^f'five bLic seLnar courses for in-service credit was 47 for Mark Twain Programs 
s^af iicludTnHnterns) and 66 for other MCPS staff. For the 1974-75 program 

year a series of workshops and minicourses is being developed to meet the needs 
2d Interests of a wide rLge of MCPS staff serving the children of the copnty. 
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TABLE 4 



In-Service Courses and Credits for the 
Mark Twain Teacher Internship Program 



Psychoeducational Assessment 
and PrograsBDing. # 



Cottpetency Area > 



lunan ftelations and 
Counseling 



CurriculMP Development and 
Implement at ion 



Behavior Management 



Systems Analysis and 
Consultation 



Cross-Competency 



Instructional Component 



Psychoeducational Assessment 
Sesainar 

Psychoeducational Assessment 
Project 



Individual and Group 
Counseli4ig Seminar 
Ccyuiseling Project 
Techniques in Human Relations 



Curriculum Development^ and 

Implementation Seminar 
Curriculum Project 



Behavior Management Seminar 
Behavior Management Project 
Adolescent Development 
Seminar ^ 



Systems Analysis and 

Consultation Seminar 
Systems Analysis Project 



Practice Teaching 

Issues in Special Education 

Analysis of Teaching 

Mlnicourse 
Adolescent Life Space 

Experience 



Credits 



1972-73 1 1973-74 Jjl74^ 



3* 

1 

1* 



4* 

1* 



3* 

1 

1* 



3* 

I 



3* 

1-2 



3* 

1-2 
1* 



3* 

1-2 



3* 

1 



(600 hrs 
10* 
1* - 3 
1 

I 



3* 

1-2 



(900 hrs 
14* 

X 

1 
1 



3* 

1-2 



3* 

1-2 
1* 



3* 

1-2 



3* 

1-2 



3* 

1-2 



(900 hrs) 
14* 

1 



1 • 



M^^gr of Credits required for graduation 



30 



32 



32 



Notes: 1. Required credits indicated by asterisks, 

2. Two elective credits required. 

3. Haxiaum credits attainable - 34. 



Lev^^ls 1 through 6 of the MCPS contiauum now employ teachers who ^^^J P^^JJ^JP^^J 
in the internship program or in some of its core courses. MCPS. by directing Mark 
Wn Programs to Sevelop staff as well as students, has created a useful mechanism 
for self- renewal. 



PROGRAM MANAGEMENT AND BUDC^ET 



Admin^Crative Stru^^ure 

The Mark Twain Teacher Internship Program is sponsored by the Montgomery County 
pubUc school system. Figure 4 shows the various administrative f-^;^!^ "^^^in the 
school system which either have formal responsibility for the Mark Twain School 
^d itsTa^e^Internship Program or serVe in an advisory capacity The intem- 
Sip program is directed by th^ Mark Twain supervisor of staff development who 
reporL to the principal of th^Mark Twain School. The principal reports to the 
^sociate sSirLtendei^t for ^iistration of MCPS, The organizational structure 
within the prpgram^ can be seen on Figure 5. . 

Management and Accountability 

Day-to-day decision-making on internship program content and delivery is the 
responsibility, of che program director and the Level 5 management group, the 
iSSLt level of staff respon^ibillJty. (See Figure 2.) This ^roup consists of 
thfrrogram director. coordinatorsTLthe five cpmpetency areas, coordinators of 
^rk Tw!in School and School-Based practica. and the coordinator for , evaluation 
and research. 

/ 

Program Budget . ^ . ' ^ 

The Mark IVain Teacher Internship Program has been by Montgomery County 

?^1^ Schools and supported by fideral and county funds. The wo-year develop- 
inental oroaram budget for FY 73 and FY 74 totals approximately $156,500. In 
T^liolT^ZsoJry County Public Schools paid between 50 and 60 Per cent of the 
refulTsalaAes of contracted staff (twelve of sixteen interns for those two 
yllrs): te l9n six-month Mark Twain Staff Development Institute had been funded 

- L a federal grant for a budget of $47,083. As an innovative project, the Mark 
liain Proeram hS to be especially attentive to program development evaluation. 
I^d to pub'S delations aspects. Funds for instructional salaries for -a nation 
Zd for public relations (communications assistant) constituted 17 and 12 per 

• Snt respectively, of the total budget. Table 5 presents the total Program 
bSget for the two-year federal grant period. July 1. 1972 to August 31. 1974. 

As a result of having established a successful program during the tvo years of 
?^derirSidJng, the ^rk Twain Teacher Internship Program is to be entirely 
supported by th^scho^ syscem. Montgomery County Pub lie, Schools will be abl^ to 
^intlin this new program in Mark Twain School on an additional budgeted cost of 
^4 JaS for FyI^. iSis budget provides support for the in-service faculty, con- 
siua^ts office and ^.astructlonal supplies, and travel. Salaries for the super- 
tJso^ o staff development (70 per cent time) and evaluation and ""^"^ -(10 per 
^Mm^^ teacher specialist (50 per cent time), communications assistant (20 
■ irJwr secteKry (50 per cent time) and part-time evaluation and research 

^rs^^^Il of ipproxI:":iyT38!000 also will be paid by school system funds. 
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TABLE 5 



Mark Twain Teacher Internship Program Budget, FY73 


and FY74 




Local 

Category . Funding 


Federal 
Funding 


Total 


Instructional Salaries ' 35,092 


bl.388 


116.480 


Supervisor of Staff Development (70% time) 26,594 
Supervisor of Evaluation and Research (20% time) 8,098 

Communications ^ Assist ant 

S A f* t* a TV 

Professional Part Time » 

Evaluation and Research 

Staff Development 

Instruction 
Support Service, Part Time 


13,014 
18,671 
9,052 

18,216 
5,246 
17,026 
16-3 




nt*H OY- Ttiq t* riirt "tona 1 


27.855 


27.855 


Const^ltants 

Supplies and Materials 
General 

Staff Development and Travel 
iJut~oi~8tate iravei 
Local Travel 
Tuition 

Furniture and Equipment 


9,000 
6,065 
4,500 

4,300 
1,000 
1,100 
1,890 




Fixed Charges: Fringe Benefits 4,562 


7,635 


12,197 


Total 39,654 


116,878 


156,532 



III. EVIDENCE OF ATTAINMENT OF OBJECTIVES 



' This section will review and evaluate the evidence of attainment of the^x pro- 
gram objectives designed to meet the primary program goal, the establishment of 
Mark Twain School as a specialized staff develppment center for the preparation 
and continuing development of personnel to work in educational programs serving 
preadolescents and adolescents with special needs. The six program objectives 
are: 

Objective 1. To identify and establish a teacher-education faculty for the 
Mark Twain teacher-development center 

Objective 2, To develop processes and procedures for recruitment and 
selection of teacher interns 
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Objective 3. To develop a cotnpetency-based teacher-development curriculum 

Oblective 4. To implement the learning experiences and activities that will 
ensure ptrticipax^t attainment of competency in five specific areas 

Obiective 5. To develop a functional system and methodology for evaluating 
toJ^ledge. attSudes. and skills for five specific teacher competency areas 

Objective 6. To increase the number of trained personnel serving emotionally 
handicapped childiren 

These objectives were developed in planning the Internship Program on the 

experience of the Mark Twain Staff Development Institute and. with the f ^elopment 
^coroJury evaluation objectives, serve as the basis for evaluation of the Mark 
•f^ain Teacher Internship Program. 

OBJECTIVES 

Program Objective. To identify and establish a teacher-education faculty for the 
Mark Twain teacher- development center 

Evaluation Objective. To assess faculty qualifications to determine if they are 
sufficient for performing functions and duties 

Evidence of Attainment of Objective 1 

A. P.nfe««ional Prep .^^^^on and Previo us Experience of the Mark Twain Teacher 
Internship Staff 

D^onona^hllitv for the Mark Twain Teacher Internship Program is a continuum 
wUh^fo So™ L accountability for both P^-ning and instruction at 
LeUs 5 and 6. (See Figure 2.) The professional P^P^"'^^*'" /^^^^i^^' 
experience' of staff at these levels is given in Appendix B. Of the eleven 
%f ^^ers at these levels, eight have advanced degrees, at the 

ma^ter^ and four at the doctoral level. Eight, including all 
c^rdLato« a^ involved in supervisory or instructional aspects of the Mark 
TaJn s'c^^ri'or the Lrk IVain School-Based Programs. Three are experienced 
in university teacher education programs. 

B. Periodic Intern Feedback 

Throughout the year interns commented regularly on the events of the week in 
Througnout cne y a settings. Feedback forms requested specific indi- 

TaSnrorac ivrtie 'e content and pacing of instruction, and suggestions 
for improvement of various aspects of the program. Completed forms were cir- 
fuLS tHemLar and p^acticum coordinators, as appropriat^e, and used as 
f^r: : ve e::i;a:ion of'program and instruction Feedback 0"/-^^^^^^-^™- 
lZ\l^o resulf-d from "Rap" sessions held during each of the three Review 
Evaluation periods when interns and Level 5 staff met for two-to-four- 
^ur "sions to exchange opinions on program content and processes and how 
to improve them- 
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coordinator must assume supervisory responsibilities for ^"/"'^""^ ~ ^ 
^nc^ei^eS Lphasis on intern evaluation by practicum supervisors based on 
performance contracts with interns. 

« .tlngB of Facu lty rttectlveness by Interns 

Procedures developed during the 1972-73 internship period for " 
. ...es. fcult, ««i.f i^TJS! %:™:r^^^^^ Upended 

rn^n.ir"est=eres;S^^^^^^^^^^ 

?rr:;nc ? TiSh r ^vroSVer's Participants greatest setlsUct 
e^cpr^Heed In response to -.J-J-^J-J f ''m^^ riiH-'-lce 

TuJ^Ic-p'^i rten e f oi:^ ll^^Z^^^r^ to one point higher on the 
course paruic pmiuo w ^ iq79-7'^ or quo The average rating of the 

was 4.2 as compared to 3.5 for the previous year. 6 questions, 

spring in-service course participants was 4.3 for each of these same q 
A summary of ratings can be found in Appendix F. 

, c^arlvP, Ratinp i» of Faculty F.f f ectiveness by Graduates 

i;,^-^-S;rrer;p^=«'rafK:^ 

instructors, the effectiveness o Ratinas for skill of instructors 

practicum supervision (Q. B-2 and Q. B-4c) . Ratings rorsKix 
'aiS the effectiveness of seminar instruction *^"^8«,'^,^;^,^%^;^de by the 
of i to 5. an increase over the average ratings of 3.4 and 3- 5 made by the 

teachers at the conclusion of their training J^^^^^'^^J^ '.e.^^^'^Lings 
^""rainrb^r ir735rgnruat st ihls uertio^ S^Lfri^ed rating 
rs r if AP endt/c in'thi form in which they were presented to the grad- 
uates for discussion at a reunion held ih July, 1974. 

E. Judgment' of Experts 

A panel of independent experts commented on faculty perfom.ance in the course 
- Jf'^^vie^ing curriculum content and delivery. The staff was commended for its 
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lastructlo-al modes, includlpg sal£-paci.g f"^ {t,^ of 

• = re:ar.srr^3r^^fa.r;:eraio^^r."a a.ri^ i.P«va.an. 

. ^raeU-rene»al. See Appendix D for the panel's report. 
.Discussion and Recommendations 

r.r«tive .Bsess.ent of faculty P"''^fJljr^l°,\Z'T,^nsT^^^^ 
participant. j*ile in program was f ^ ^ JH",,, „aeaa.ent from 
in program. schedules, activities, ana roxe u -^aduates Who had been on the 

participants at the conclusion train n« -^^^^/^^f ^^f^f/effectiveness . 

job for a year was f?J°"^,^/-J^"^^Thri972!" graduates rated faculty effect- 
higher than did the 1972-73 interns, ^he 1^ /^^ g conclusion of 
iveness higher after one year on the job than cney 
training. 

^ o^=.ff rproonized the diff J -ulty of determining specific 
The program management f ^"^"J^^nized the d J currently available. 

criteria for faculty 'P^^ ^"f ^"'^""to^.ndix A) Ld the curriculum review panel 
Both the independent --^"ff^/f.^^^^^f^fJ^gJLS specif icat ion and evaluation 

report JAPP^*^", J^^JJ^f'^l^^lS^r ir^ecom^indations'made by these independent 
of facufty qualifications. A number or r management staff and 

reviewers already had been addressed by the Pij""^"? ^ * D delineation 

scheduled as goals for 1974-75. J^^^JJ^'j^Jiri^Jiins and role function 

«f 4nK functions ^-o ttulde assessment of faculty quaxiiicai-xuiio 
:^d^* iTi^Z priLr, inatructional ataft from <«.rk overloads. 

in-order to accelerate progreaa t<»ard attai^ent of Objective 1. the following 

recommendations are made: 

Delineation of categories of staff ^-lifications ».d iob-related »^ 
e.,*. '"=«iv~f pres-tatio^; su«^ n^the f ld.^ade, 

S^;rjrrr:ie:u""ecinliu:;. and ^Lrials: co^t»nt to teacher training. 
Establishment of criteria to assess the match of facult, and function based o. 
the above. 

increasing opportunities for trainees to become trainers. 
OBJECTIVE 2 

Program Objectivi. To develop processes and procedures for recruitment and selec- 
tion of teacher interns 

Evaluation Objectiv.. To assess the effectiveness and feasibil't, of the recruit- 
ment and selection processes 
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Evidence of Attainment of Objective 2 

A. Feasibility and Effectiveness of Recruitment 

Recruitment for the 1973-74 internship began in Februarys 19 73. In addition 
to periodic announcements of the program in the Superintendent s Bulletin, a 
weekly publication going to all MCPS employees, presentations were niade to 
nine selected MCPS groups. Three orientation sessions werp held at Mark Twain 
School to publicize the program and to invite applicants. Recruitment efforts 
for 1973-!74 elicited 25 applicants, 9 of whom withdrew their applications, one 
after Phase II selection. 

Recruitment efforts for 1974-75 began in February, 1974. In keeping with the 
recommendations of the evaluation of the previous year» a more intensive 
campaign was mounted to reach all possible prospects. Announcements were 
placed in the MCPS Superintendent's Bulletin . Current interns participated in 
•presentations to selected MCPS groups and in orientation sessions at Mark 
Twain School. School-Based Mark Twain Programs staff were enlisted in pub- 
licizing the program at their schools. Every Montgomery County public school 
principal was sent information on the internship program with a letter request- 
ina his cooperation in informing his teachers about the program. Twenty-five 
applicants resulted from the recruitment efforts for 1974-75. Of these, two 
withdrew their applications before decision by the selection fiommittee and 
three after selection. Table 6 shows final disposition of applicants for Mark 
Twain Teacher Internships. > 

B. Feasibility and Effectiveness of Selection 

The selection process for interns required completion and review of personnel 
data! applications, and references, as well as group and individual interviews. 
Of the 25 applicants for the 19 73-74 internship. 8 were accepted, 7 were not 
recommended, and 1 was recommended for reapplication the following year. Of 
25 applicants for 19 74-75. 10 were recommended and accepted, 1 was recommended 
but not approved by MCPS Department of Personnel, and 9 were not recommended. 
Five withdrew their applications, 3 after Phase 11 acceptance. 

Discussion and Recoramendatjtons 

The recruitment procedure for 1972-73 had proved less effective than desired, 
resulting in only 21 applicants, 6 of whom withdrew their applications prior to 
decision by the selection committee and one after selection. Earlier and more 
extensive recruitment efforts for 1973-74 resulted in 25 applicants, 9 of whom 
withdrew; one after Phase II selection. This high rate of withdrawal of applicants 
suggested some lack of clarity of information provided in recruitment ef farts, 
particularly since the reasons stated for withdrawal were primarily financial and 
degree-related. * ^ 

The intensive information dissemination program conducted for 1974-75 recruitment 
resulted in 25 applicants, only 2 of whom withdrew prior to selection decision and 
3 a?ter seLction! The reduction in withdrawals is seen as evidence that recruit- 
Lnt efforts reached more viable candidate, and provided them, with the information 
needed for realistic decisions concerning their candidacy. 
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TABLE 6 



Final Disposition of Applicants for 
Mark Twain Teacher Internships 



1 in 


1972- 


-73 


1973- 


■7A 


197 A- 


•75 


Ulspositlon 


nCFS 


Non-MCPS 


MCPS 


Non-MCPS 


MCPS 


• 

Non-MCPS 


Recomnended and Accepted 


6 


2 


6 


2 


8 


2 


leconmended but not Accepted^ 










1 




ot Reconmended 


3 


2 


A 


3 


6 


3 


Withdrew After Selection^ 


1 






1 


2 


1 


Withdrew Before Selection^ 


A 


2 


7 


1 


2 




^commended for Reapplication 














Next Year* 


1 






1 






Total 


15 


6 i 


17 


8 


19 


6 



1. Request for assignment to academic leave was not approved by Department of Professional 



Personnel because applicant was needed to perform duties as assistant principal 

2. Most frequent reasons given: commitment to present position; leaving area as result of 
spouse's reassignment 

3. Most frequent reasons givenj financial; no M.A, degree ^ 

4. Insufficient teaching experience 



The enrollment of 10 applicants as interns for 1974-75 meets the requirement of 
the preliminary evaluation plan for evidence of successful recruitment and selec- 
tion. As recommended in the report for the previous year, selection standards 
were maintained and complete procedures followed. The selection process, while 
lengthy and time-consuming, does indicate a high degree of commitment on the part 
of both applicants and staff. Although there is no way of knowing how well those 
who were not recommended for internship would have performed, it Is apparent that 
those selected each year have successfully completed an intensive and demanding 
program. 

If current explorations into authorization for awarding of the M.A. degree upon 
successful completion of t>e program prove fruitful, the feasibility of recruiting 
candidates who meet high selection standards should be even greater. Present 
evidence, nevertheless, indicates that the objective of feasible and effective 
recruitment and selection of interns for the Mark Twain Teacher Internship Pr(^gram 
is being met. 

OBJECTIVE 3 

Program Objective. To develop a competency-based teacher development curriculum. 

Evaluation Objective. To assess the adequacy of the multicompetency teacher educa- 
tion curriculum for its comprehensiveness and internal consistency. 
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Evidence of Attainment of Objective 3 
A. Judgment bv Program Staff 

C»pe.e„c, area cocdlnato.s -"'"^ ^\ra:rs^ufco::rrafef :n"^lirU^s 



activities, 

objectives, and behavioral objectives. 



The p.l.ar, cu„lculu. goal of the progra^ .tat£ ^f^J^f ^ralar/obrec":):' ' 
progreaa toward the competency-baaed model, ^he match ot 
io ccvetenc, statements was again reviewed. S"ps were 

seminar content - ^a'r oTp =rsipervisoL and'participants 

lnr:™1rgrartiranr:reif supe-rvLors we. . and nsea as 

appropriate in revision of course content and delivery. 

B. Judgment of Participants. 

X„ addition to ovclical ieedhac. -^/--..Sr^rfu^rirnmtm^^^-Lr 

f„i'ro.^i:^irn-.T r eS^^^^^^^^ 

were "'///."el ^Sti^ signiticantl, from 2.5 to 

intern pre-post training sexr evd Average increases were equally 

4.5 points (on a J-P;i"^ ^ '"Lditi uar^ffe^Uons were requested from 
great across all ^^"y and June of the 1973-74 program year, 

interns in August, November, ^^''^"^^y* /"^^i"" . expectations as well as 
Opinions- about progress toward P"^°"^; ."^^^dX^esses of the program 
general thoughts and feelings on the ^J^eogths and weakn ^^^^P ^^^^^^^ 

were sought. ^^^^^ ^^"jSi!',:^ 'ione^^^^^ often as program strengths, 

and experiences with children being ""entio frequently as a weakness. 

Slow feedback on task evaluations was f^'^Helf-confidence, and 

increased feelings of professional ""JP^J^""' f typical of m^n^ sum- 

heightened self-awareness were consis^ 

reslesTnfho:"to"p:t^:;"st :^gths to work for me I ^deal^^ 

and trusted." 

.t the conclusion of "--Jd'e^crr^aJld ^ 'e»ecS" 

about the instructional program. E^^'^^""/^. obiective 2. Interns rated 
iveneas of instructors /"^^'-^r.^f.^r^vered ^tem 13), difficulty of 
scope of seminars and amount ^^^i^eoretical considerations (Item 17a), 

material (Item 15). emphasis placed ""^^eoreti ^^^^^^^^ ^^^^^ 

rr^.Sr^ranrr^rresrectivel;. Tl "ale^f 1 (not enough) through 3 | 
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(about right) to 5 (too much). Mean ratings across learning areas on the use- 
fulness of skills taught (Item 20) and overall value of seainMfs-dtem 21a) 
were 4.2 and 4.3 respectively on a -scale of 1 (poor) to 5 (excellent), a 
considerable increase over the ratings of 3.5 and 3.4 of the previous year. f 
Comparison of the ratings njacTe on these items by participants in the fall 
schedule of seminars limited to interns and Mark Twain Prograas staff with 
those made in the spring by a general enrollment of MCPS staff shows almost 
identical mean ratings across learning areas. However, interns and Mark Twain 
Programs staff rated somewhaC higher than MCP6 staff on the Systems Analysis 
course, somewhat lower on the Curriculum Development course. Appendix ? shows 
mean responses by competency learning area for all groups, and also, some 
frequently citH most and least effective learning experiences in 1973-74. 

Judgment 'A Graduates and Their Supervisors 

Responses \o a questionnaire by 1972-73 graduates after performing on the job 
for a year were tabulated and compared to their ratings of the program «t the 
conclusion of training. While ratings of all aspects of the program w .e 
modterately favorable (3.0 to 3.6) in. June, 1973, they were markedly higher 
(3 I to 4.1) in June, 1974. Former interns were asked to rate the relevance 
of the 15 competencies which are the learning goals of the progs^, and also, 
their effectiveness in role performance. Their principals ot supervisors were 
asked to make the same ratings. Interns' self-evaluations w«re almost iden- 
tical to the evaluations of them by their supervisors on eac^ item^ Both 
groups rated all competencies as highly relevant, with the ptincipals noting 
somewhat higher ratings on relevance for assessment and programming compj- 
Jencies,' somewhat lower ratings for interpersonal and facilitating competencies 
than the graduates. These results can be seen in Appendix G. 

* '•- >^ ' 

Judgment by Experts in the Field X 

The Maryland State Department of Education examined the curriculum of the 
1971-72 Mark Twain Staff Development Institute and the Mark TVain Teacher 
Internship Program. Both programs were acceded as leading to «°dor3e«ent of 
thrparticipants' Maryland professional certificate in tii4 area of special 
education. Participants also earned at least 30 in-service credits for 
successful c«hpletion of the training program. The five basic learning area 
courses-Phychological Assessment and Programming, Human Relations and . 
counseling. Curriculum Development and Iii|,lementatiori, behavior Management, 
and system^ Analysis and Consultatioty'-were submitted to the MCPS ^visio^^of 
Sreer Programs for accreditation asUndividual in-service courses. Approval 
was granted in 1973 for awarding MCP^ personnel with thret credits for each 
completed derainar course- 

A summative evaluation of the competency-b^sed teacher develppment curriculum 
was accomplished during a two-day on-site visit of an independent panex of 
everts on general, special, and teacher education. The panel's report can be 
seen in Appendix D. .Congratulating the program planning and instructional 
staff for successfully Implementing a valid competency-based teacher education 
program, the panel noted the following: the internship has a real world 
approach fodusing upon a specific job description and . . . role, and the 
competency-based asject of the program is timely; the attempt ta develop a 
comJeJency-based component dealing with the affective domain is a forerunner 
in educational practice." ' • ' ' 
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The experts addressed comments and suggestions to specific areas: 



1. 



Co mpetency Specification . The five learning areas were found to 
represent the necessary components for training personnel to work 
with adolescents having special needs. Some areas (Psychoeducational 
Assessment and Curriculum Development) could be strengthened by 
greater depth and intensity. Certain topic areas should be added 
(e.g.. prevocdtional curriculum) or expanded <e.g., group counseling). 
The panel recommended the 1) elimination of overlap in statements of 
competencies, 2) institution of a system of "expert" advisors to 
consult with learning area coordinators on the further delineation of 
competency statements, 3) consideration of objectives which are met 
specifically in practicum, and 4) clearer comnunication ^ the compe- 
tencies to be gained to the interns prior to instruction. 

I nstruction . Findings of the panel relative to faculty performance 
were discussed with Objective 1. Panel recomnendations for improving 
the instructional process included 1) study of the process by the 
faculty as a group to find ways to use the technical resources of 
Mark Twain School, to reorder content into more manageable units, . 
and to integrate seminar and practicum experiences; 2) self-pacing of 
both seminar and practicum activities as soon as procedures can be 
formulated; and 3) rotation of interns through a greater variety o£ 
practicum settings for experience with different models. 

C ompetency Assessment . Assessment of competencies -was fo.md td be 
telated to stated learning objectives and in most cases precisely 
delineated. The panel recommended 1) greater use of the natural 
setting, 2) greater consistency among- those responsible for deter twin- 
ing when competency is attained, .3) more Immediate feedback on 
individual performances, and 4) a deliberate*;af fort to match compe- 
' tencies to be attained with a particular practicum site. 

Hu man Relations . The strong emphasis in the program on human rela^ - 
tions was found i:o be evident in the warmth and concern of people fox 
each other. However, the panel did see some resentment by interns of 
certain aspects of the program. It was recomended that self-pacing, 
self-instruction, and inclusion of interns as "tru^ted and worthy 
. participants in a "team effort" would be highly desirable. 

5. Program, Management . As was noted under Objective 1, management of 
the program was seen to be well defined except for 'the provisi-n 
staff assessment and improvement and some time for self-renewal. 
The panel recommended 1) use of a resource center retrieval of 
materials system; 2) elimination of duplication of objectives and 
finding of more efficient training strategies; 3) analysis of the 
practicum experience to clarify process and verification and evalua- 
tion of competencies; 4) inclusion of a component to develop compe- 
tencies for training other teachers; and 5) establishment of a coop- 
erative working relati^ship with a local college or university for 
new ideas, continuous consultation, and perhaps, a master s degree. 
Finally, it was recommended that the program attempt to move froai an 
experimental, minimally funded, pilot project to one with adequate 
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funding, tesources. and personnel. Greater public dls-e«ination 
through articles, conference appearances, etc.. of the program s 
"many outstanding features" was strongly encouraged. 

Discussion and Becoaoendations 

Development of the competency-ba^ed curriculum was a major goal 
internship year, and evidence presented above supports progress J^^a^J 
. attain-en? of that goal. A nu«i.pr of modification^. in content and delivery 
^esultcil fro- «iggeStions of staff, participants, ^r^iuates. 
side advisors. These ranged over the entire training spectrum from learning 
S^cJ?^sTt;te^ts tf^o^sideration of changes In assessment procedures. Among 
wecific actions taken were 1) use of a practice activities reference list to 
euide oracticum evaluation. 2) Institution of two;;credit elective projects. 3) 
^^in^tat^nt^f^Jsits to other special education facilities and helping agencies. 
:f «dSt^tJon of procedures for practicum placement -j°'*-^f ^» f ^^^'T . 
vi«nr« 5) some revisions of learning area descriptions and conte. . 6) weekly 
S^uJ «e i^wUh tin^g^ervisor of school-based programs for i. ^ <»oi^- 
fj^ek rchofl-based pracScua. and.7) Institution of a fdculty advisor -ys^e- on 
r^t of aiv intern. Techniques of identifying needs for change through periodic 
I^SdbacR have proved adequate and have led to implementation of the- changes. 

The curriculum review by a panel of experts constituted a major assessment of ' 
atta^^nt ofthe program curriculum objective and its corollary evaluation 
oMec^!^ The filings and recommendations of the panel were cogent and succinct 
id^ir^roSSe uSf^l guidance in advancing the model. Nevertheless, they must 

c^sldered in light of the limitations common to short-term site visits: 1) it 
i: i:^oss2!e t co^letely inform even so diligent a group. R^^Je numerous and 
roBolex facets of a program; 2) some misleading impressions, arising from the 
TlSro individuals o'r th; limitations of time, understanding «e 
in^'itable; and 3) judgments may be made on past performance and neglect modifi 
cations already in process. ^ 

A number of the panel's recomendations were recognized by the staff «°<» "J^^^"* 
U^^nted: l)'previous participants (10 a yf')*"^f'^8"*^°f, ^3:^:1°:" 
^^^^^o^rh aPiBir^rs relieve primary instructional staff, and take m-seryice 
™ S :^hop; "™ty sSools; 2) course modules in group counseling 

teacMnK^f reading are under development; 3) institution of a continuing 
:C?s d^ ad^Lory panel'is being explored; and A) ^52^": ^'^.f .J^^^ 
area universltSs and the >i.ryland State '° "^''^"^ 

Master's dearee fur successful completion of th2 program. JWitional panel pecom- 
^;:aons S^t be coasiderea a.^nger-range goals, given tiV f /"jf 

ICr^d ^^rs^el. These include 1) pack^ing of materials to utilize the tech- 
SioScarres^rces of Mark Twain School and allow self-pacing of instruction; 
^^tSlishlnror criteria and procedures for complete competency assessment in 
%^:X^:o^S' ^Z^s^-^^^ of'sufficlent funds to provide for addit onal per- 

fchraJt:r1h^ - - unacceptable to progra. 

>8taff. 




^^nh anH delivery and Uhplement the review panel's 
To iwprove curriculum content and delivery "'i' 
motions as feasible, it is recommended that. 

Procedures and modifications as noted above be continued. 

some- topic areas not now covered, such a. teaching of basic skills and 

prevocational curriculum, be a'dded. ■ » 

staff , consumers, and the comunlty. 

sources of additional funding for materials development end dissemination be 
explored. ' ^ ^ 

OBJECTIVE 4 J\ 

Program OMectlve. ^ implemenl ^'-^^^t^'Mtj^Sd^cltlo^ifAsre^ 
ensure particxpcuiu 

attainment ot compe x» - Development and . 

S'lof. TT..^iTX:ZL^^^^^^ ---- - 

Evaluation Objective. To assess each Pa- icip^^^^^^^ "^^^^ 
for his competency in each of the above five areas. 

Evidence of Attainment of Objective 4 

for all five competency learning areas during a 
Learning-sequences P/-^f3^J 30^eeks cf practice 

41-week training schedule of 75 '^^^^^ . individual {Trojects. To 

::^^:fL%re;aIuirir:.!:ri;e:'1h:erLtLct .ut interdependent activities 

were conducted. ^ 

A. Assessment a t the Competency Level 

„■ xntern assessment culmin^ed in a finf — ^^^u^^ 

performance as MS^^^^fH^' ^^f^^^ Twain Teach tr Internship 

the 15 competencies. All intern, ^^e l^/i evaluations 

program completed the ""f f ""^^/^ff '^e;en tLug^ some specific task 
of effective or better in all ^"""P^J^^^^^'^^trwere missing because of absence 
■ performances .^"3 rnu^Jer of interns'in each evaluation 

or task incompletion. Table 7 "'7973_74 program years, 

category by competency for the 1972-73 and 1973 74 prog y 

1 nf <ntem8 was determined by a weighted integra- 

The final summary evaluation of i^-^^^^^ a area coordinator, 

tion of ratings from seminars -d practica. Each co^pet^ subjectively eval- 
using results obtained from both "J*^*^ J^^",, mating each intern on a 
uated performance tasks - ^b „ , ^1;^:^^ was felt the interns had 

Thro^po^tuliitrtolLl'Lnr^he fleld setting. In 1973-74. the 
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p,tf o««nc. rating, for th. 16^.1c practlcua (oc^rrlug -Jj*' ••jj?^. 
Sded) were u-aTL ih« .u—tlv. pr.cticum rat^g and ^"J^"!'*,^^^. f * •j'^" 
p«£o«anca rating. In a ratio of two practicur to ona .anlnar for thj final 
^S^aluatlon. Tha* aarliar 7^eak practlcum aaseawanta wara .J^'^JJarad ^ 
J™H«r«d wara uaad for counsallng and £<>r Indicationa of needed nodlflcationa 
S^fSdJJld^I'a^Sg*^ in . fiw lnBt:anc.8 althar an N (ho opinion or oppor- 
Tu^y S d^^trltrthepo-pat^ncy) appaarad for tha 16-waek or^«* 
SS^JUon Tbaliev. It waa not the best asseaament of tha i^""*'* 5'!^°™?!'^*- 
^^Te caaa., tha ratings of the two 7-«aak placeaents were averaged for the 
final practlcum rating* 



TABU 7 

FrMtMBcy OUtrtbutlai of flwa SuMty EvaluatiMi of Iat«M hy 
CMy«cracy for th« I97a-7J sod 1973-7* Proftrwi ttiro 



/ 

1 


SCfPttlt 


1972-73 


MiihiT 

flf«ettv« 


llMd* 


1973-74 

EffMtltW 




CM%t%nCf^ : — i 

1. 1 Conslatlon of ■ fiycbp^dttCttloMl froflU 
' 1.2 Itea of Aaatat— nt Infot—tloft for rrogftal^ 


0 
0 


6 
6 




0 
0 


1 
0 


7 


2.1 Efftctivo CoaprohmfioB and CoMoicacioa 

2.2 Efftctivt latvfactlon 

2.3 racilitatlng HuMoiatlc Education In Croup* 


0 
0 

0 


2 

2 
5 




0 
0 
0 


0 
2 

0 


1 
• 
1 


3.1 Dtv«IopMnt ot iMtnictlooai SyatM 

3.2 Da^lopiMJnt of Apptoprlata Currlcuft* 

3.3 Inplopentatioo of Uarnlng Actlvltl«# 

3.4 SaUctlon of Approprlata ltot«rlala 


0 
0 
0 
0 


3 
2 
3 
2 




0 
0 
0 
G 


I 
0 

0 
0 


7 
1 

. 1 
1 


4.1 RalnforccMtnt of Mhavlor Valuaa 

4.2 Taaching Coping with Fruatratlon 

4.3 Vaa of Intarvention Tachnlqa«a 


0 

c 

0 


4 

3 
4 




0 
0 
0 


0 


1 

7 
7 


5.1 CoMun^atloo of Conctpta of ,Syat«» 

5.2 Uao of OrganisationAl ProcMoaa 

5.3 Uao of Cooaulti^lon Proeaao 


0 
0 
0 


2 
3 
3 




0 * 
0 




5 
4 
ft 



• SM *pp«»<l« « tot coniUt. St*tMm» of Co#«t««el«fc > 

B. AflBeasment hy Performan ce Objective 

The assessment of Intern perfoSance at th. '^f *~"LJjJei d°e?Ined 

■tltuted a aummative evaluation. Each competency, however, "/"""^Lrof 
ll Tset ofWfomance and behavioral objective statements. .Assessment of 
i^tLrperfomance at that level waa formative l^^-''-^ ^^^^^^^^^ 
' nroeedures and techniques for evaluation of Intern progress towara 

TJ^te^t Uor^iuv'. "fiction) .er. dictated by th» "'.IJjJ^, . 

'dnLins 'objective.. Since J«J/.^nr.s^:;1""c;\«'«::.:s 
Sir "ih: rp;.^Scr:src'tir ?Jr Tic Jhodeio,, bee„ 

n«lop^! ror .oie competency leetnlng ereee. prl-^ry Instructor, felt It 
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more appropriate to thfeir evaluation needs to assess on the basis of task 
^HgnSi^nts which integrated a number of performance objectives Intern«^«'« 
permitted to recycle tasks as often as necessary until an adequate level of 
performance was reached. In some few instances, by arrangement with the 
Instructor less than adequate scores were allowed to stand when they did not 
«dice -overall ratings beJow an effective level. However, no final evaluation 
of a competency aS Highly Effective could be reaphed without- completion of all 
tasks related to that competency at an adequate or better level. Judgment of r 
the validity and reliability of the instruments and procedures "^ed is pre- 
sented with Objective 5. Assessment results at the performance objective or 
task assignment level by competency, area follow: 

1. Psycho educational Assessmentu and Programming 

• The learning" area was defined by six performance objectives, each of 
which was evaluated within the framework of a comprehensive examina- 
tion that closely simulated role performance. Specific questions 
yielded 12 scores. indicating effectiveness of performance (strong, 
adequate, or weak). Appendix I shows the number of interns scoring 
in each evaluation category on each exam section with performance 
objectives that can be associated with each question. All scores 
were adequate or better. Instruments are described in Appendix H. 

2. Human Relations and Counseling , 

Assessment of intern competency led to 10 performance "^ings related 
\ to 7 of the 8 performance objectives. Appendix I shows the distribu 
tion of performance ratings. Techniques are described in Appendix H. 
\ Although some individual tasks originally received a "^ing of lass 
than adequate, multiple opportu. Ities were given to meet criteria. 
Ml interns averaged effective or better for each competency. 

3. Curriculum Development and Impleme ntation 

Ratings on 10 of the 12 performance objectives represent the evidence 
collected for demonstration of competency.. Appendix. I shows the dis- 
tribution of scores. Jasks are described in Appendix H. Aft^r 
^ recycling, no individual task scores were rated as less than adequate, 
and all iilterns achieved effectiveness on the competency level. 

4. Behavior Management n \ 

Assessment of intern competency resulted in 11 performance ratings 
These ratings indicated the degree of competency of interns related 
to 7 of the 7 performance objectives. Distributions of scores by 
related performance objectives and assessment techniques are shown in 
Appendix I. Techniques are described in Appendix H. Recycling 
brought all ratings to adequate or better levels cf performance. All 
interns rated effective or better in all competencies. 
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5. Systema Analysis and Consultation 

Assessment of Intern competency, resulted in 5 ratings on task assign- 
- nents related to 5 of 8 performance objectives. Appendix I shows the 
(Jisvibution of scores. Three task performance scores were recotded 
as less than adequate, but effectiveness was achieved at the compe- 
tency level by all Interns. Techniques are described in Appendix H. 

In addition to mofe formalized assessment techniques described in Appendix H, 
Vch seminar Instructor utilized informal observation of intern progress in 
graded and ungraded learning activities. In most instances, these informal 
techniques- covered those performance objectives not assessed formally, 
t » 

c' Assessment of the Impact of the P rogram on Attitudes and Values 

A battery of tests was administered as a measurement of the impact of the 
training program on attitudes and values. A brief description of each instru- 
ment and a summary of median scores are shown in Appendices H and J, respec- 
tively. The Wilcoxen Matched-Pairs Signed-Ranks Test was used test pre- 
and posttraining score differences for statistical significance (Siegel, 1956). 
This nonparametric^ test utilizes information about both the magnitude and the 
direction of differences between pairs. 

Based on previous findings, e.g., Fagen and Long, 1971; MCPS Report on Institute, 
1972, the fallowing hypotheses were generated: 

1 Positive shifts on 'the Specialized P roficiencies for Working with Excep- 
tional Children in "confidence" for "Knowing the Child," "Curriculum 
Materials and Methods." "Counseling and Behavior Management, and Parent 
and Public Relations" and on both "confidence" and importance for 
"Testing and Psychoeducational Assessment," "Teacher as a Professional 
Team ..orker," and "Teacher as a Worker," indicating increased confidence 
in their abilities and acknowledgement of the Importance of these 
competencies 

2 Shifts on the Teacher Practices Questionnaire in group role perception, 
with decreases in "disciplinarian" and "reterrer" functions and increases 
in' "counselor" and "motivator" functions 



3 A positive shift on the "Inner Directed" scale of the Personal Orientation 
' Inventory , indicating movement toward more of the characteristics of a 
self-actualizing individual 

A. Shifts on the FIRO-B toward more balanced and flexible interpersonal 
behavior 

5 A positive shift on the Minnesota Teac her Attitude Inventory, suggesting 
increased abUity to interact effectively and promote mutual problem 
solving 

6, Positive shifts on the Profile of Orp anizational Characteristics in 

ratings of organizational characteristics, indicating increased preference, 
for a democratic school organization . , 
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7. Shifts on the P^^hlPm Behavior Analysis, indicating a) anticipation of 
less frequent "Oppositional Behavio'r" and more frequent "Failure to 
Follow Through" and b) being less disturbed by "Overt Aggressive Behavior 

8. Positive shifts on the Self-Evaluati on of Competencies indicating 
Increased confidence in their abilities 

The c.o.^.n..H Proficiencies for Working with E xceptional Children Questionnaire 
(SP pfwas administered to document th e 4act of the training program on partici- 
nant«' (1) confidence in their abilities in specialized competencies and (2) 
actoowledUnt of the importance of these competencies. This list of teacher 
^oS^encLs was developed as part of a study. Teachers of Children who are 
.oSallv and Emottonallv Maladjusted , conducted by ^^e Office of " ^^^J^!' 

et al.). -Som e ipodif icatioa of items and format was made. Table 8 shows the reia 
ffoflhi; beLee! the seven sections of the test and the five program learning areas 
along with the results of the statistical testing. 

The chanKea in scores' from pre- to post internship were tested using the Wilcoxen 
SitcheS!?airs Signed-Ranks test. Increases in confidence on six o seven sec ions 
^:rf s2ati\ticai?y significant, indicating Pof^^- changes ^ trainees con^^ n^ 
in their competencies in those areas. In contrast to the 1972-73 interns, "^"^re 
i^s no sigSicant shift in confidence in "Teacher as a Person, but median pretest 
8Cores we?e well above the midpoint of the scale. A statistically significant . 
sMft in confidence related to "Parent and Public Relations ' was observed. None 
of tL statistical tests performed was statistically significant relative to 
changes S the l^ortance trainees placed on the competencies. However, as in 
S^?73. median Tretest scores for importance attributed to the competencies were 
high. , 

Changes in "frequency" scores on the Problem Behavior Analysis were statistically 
signmca^t for all Lnlf estatlons . indicating anticipation of f^J^f^J^ f 

but "deviations in Social Development." These results were as hypothesized 
Seep? for "Failure to Follow Through." No statistically significant changes were 
observed in ratings of reaction, though changes were in the direction hypothesized. 

Using the WUcoxen Test, none of the five additional standardized 
u ^^ o o^a^^«tlcallv sienlflcant difference in scores from pre- to posttraining 
fx":' ?n isola eS siLcafes Swever. many scores were well above average on 
:^th pre- a^d posttest; and most observed changes were in the predicted direction. 
For e^mple. the median scores for the Personal Orientation Inventory, Inner, 
Mre^J^d (the major test scale) were converted to standard scores -ean - 50 

Lvlation - 10) using adult norms, yielding 62 on the P"test fnd 68 on 
the posttest (as compared to 56 and 57 for the previous year). Similarly. 
M^^n^;" Teacher Attitude Inventory median scor.es placed the ^"terns at about the 
mh Percentile in both the pre- an d .ttest (compared to the 76th and 80th for 
1972 ?3) relative to secondary academ- teachers with five years experience. On 
^ I'; ! .:. Prlt Questionnaire, scores changed in the predicted direction for 

rotes of "Referrer." "Motivator ." and "Counselor" but not to a signlfican 
Segree These results are in substantial agreement with those observed in 1972-73. 

The 5;.lf-Evaluation of Competencies discussed earlier, showed marked Increases for 
all items. 
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TABLE 8 



Relationship Between Learning Areas and Subtests of the Specialized 
P roficiencies for Working with Excep tional Children Questionnaire with 
Level of Significance of Change Scores for Importance and Confidence 



Psychoeducational Assessment 
and Programming 



Learning Area 



Test Section 



Knowing the Child 

Testing and Psycho- 
educational Assessment 



Significance 
1972--73 1973-74 



Importance N«S 
Confidence * 

Importance N«S 
Confidence 



N.S. 
** 

N.S. 
* 



Counseling and Human 
Relations 



Teacher as a Professional 
Team Worker 

Teacher as a Person 



Ci^rriculum Development 
and Implementation 



Curriculum Material and 
Methods 



T 

]|iehavlor Management 



Counseling and Behavior 
Management 



Systems Analysis and 
Consultation 



Parent and Public 
Relations 



Importance 
Confidence 

Importance 
Confidence 



N.S. 
** 

N.S. 



.S. 



N.S. 
N.S. 



Importance 
Confidence 



N.S. 
** 



N.S. 
** 



Importance 
Confidence 



N.S. 



N.S. 
** 



Importance 
Confidence 



N.S. 
N.S. 



N.S. 



* Significant at the 5 per cenc level. 
** Significant at the 1 per cent level. 

Discussion and Recoranendations 

Th» 197-^-74 Mark Twain Teacher iu.ernship Program reached its objective with all 
I^er!I atta^^Ing at leas? an ade^.aate level of performance in all competencies. 
delt^aUdafioi^f trainee performance relative to stated competenc es 

E ; riTob^ 

^^^S^ :irt- re^t:^ -^re^^-pe^^-fnce^n^^^^^^ 

were obtained tor aii id oi tue ^ increase confidence in the final 

the instructional and the ^^ural set ing. To increase conf id ^ ^^^^^^ 

evaluation of intern competency, multiple ratings were P°o^ " 

upon the whole range of experiences and data available to the rater. 
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^ Hii^r rlu^. than in 1973-74 (see Table 7) reflect this change. 
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at least one assessment for each behavioral f '^Z" P^"^ "n^'^^f^^i^^J^^er^or^nce 
narrowly missed. Assessment was accomplished relative to 35 of "^^^^^ P^"°"^ 
oblec^ive^ In addition, care was taken to distinguish assessment tasks from 
grided Tea;nifg activiti;s. with only the former contributing to Judgment of com- 
petency attainment. 

In some cases the assessment techniques did not adequately sample the behavior 
• nJ^T^uMna the oblective. Some assessments did not require the trainee to 

ZZrd solution of the assessment problem is discussed with objectiv.. 5. 
The results obtained from administration of the pre- P-"==''°=""^^;5^ 

tnents, however, pretest scores were wexx ctuuv ^^n^Ate selecticn procedures. 

I^ca^nalysis; in some instances its lack of power could be responsible for 
failure to meet the test for significance. 

In order to increase the effectiveness of assessment of attainment of competency. 

it is recommended that: 

Continued efforts be directed toward assessment of competency independently 
in the natural setting after the conclusion of instruction. 

Seminar assessment tasks be streamlined to allow prompt evaluation and 
prescriptive feedback. 

consideration be given to substitution of a two-point rating system for the 
current seven-point scale. 

w 
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Alt.m.tive methods b.- devised for demonstrating a specific competency and to 
provide greater assessment flexibility. 

Efforts be renewed toward competency pretesting or "validating out." 

The battery of tests of attitudes and values be revised to «<=l"fe those 
il;:tr^nts no longer appro,^ate to current intern needs and numbers. 

OBJECTIVE 5 \ 

Program Obiective. To develop a fu\tional system «id methodology for evaluating 
to^l^ge^atti^^es! J skills in Se specific teacher competency areas. 

Evaluation Objective. To assess compelcy -^-^-f,,^"^^^ 
reliability, examinee appropriateness, arid administrative usability. 

Evidence of Attainment of Objective 5 \ 

..^ - n mr-aa H^ftWnct but related activities have been 
TO accomplish Program Objective 5. «^hree dist^t but r independent 

initiated: (1) the development of P""J"J" eacS^coJJete^cy^tatem^nt; (2) 

validation of "ai"- P«^°^^^« rec^iqie loTas:::' trfinee attainment of stated 

h^lTLl', lddi;ioS/rirpLd::"-U :f rh^n^rLhip evaluation was 
contracted. 

At this pol-t in the develo^ent of the ^^,«'-j:r,jt/riitoS»av.°Lf 
eveluation methodology, progress toward meeting "^J^^JJ^ „ 

Sered adequate for demonstration of the stated objective. 

TO the present. prograB resources have ^^-'^^ITT^U'^^'''"''^^^^ 

^^^^ ^^^^/Pf^^i}^- " 
tency level remains a need to be emphasized in the future. 

A. Techniques for ViHrUrl- r»nmPtP,ncv Attainment 
validation of '^l^,Zt7Z' 

r^f-hirn^n? » 

dures such as a generosity error, instability and unre- 

ambiguity in meaning of attributes to ^^^PP^^J'.^J' ^jj^s w"e not established, 
liability of hums,, judgment. »«^«-"-^"^,'^ti^"'iJ',l^''thruse. of multiple 
However, in addition to the face validity 3^^^ Ratings of attain- 

sources of data .ids to the usefulness of ^r^^^/^^J^f ;„ ^^foLnce of 
„»ent of competency learning objectives in seminars^ests on p 
clearly specified assessment a .3 Wh le^^^^^^^ ^^^^^^^^^ 

tive, they are f^^^Vof thl Js competencies. Summary ratings combining prac- 
rrl^rreii^LTa^it^'oiLr^^^^ -d reU^MUty than either 



would alone* 
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Techniques for Aasessment o f Skill and KnowledRe Attainment 

Tn 1972-73 the procedures and techniques used for skill and knowledge assess- 
i^nt werr;eJiewed brthe evaluation staff, and the mtch between instruments 
!^dbIhIvlorIl obi ect Ives was made explicit. Techniques then were submitted 
to a^ "outside exper " for evaluation' Criteria used fy judgment were devel- 
nirhv ^S! Center for the Study of Evaluation, UCLA, a^d reported in 
r±^L y.^"nrTe:: Evaluations (1970). Results of the evaluation were 
reputed In 1972-73 but were too l ate for formal use by instructional staff in 
ol^ning 1S73-7A intern assessment. Nevertheless, improvement of evaluation 

formal evaluation during the previous year. 

Techniques for Measurement o f Changes in Attitudes. Values, and General 
Knowledge 

A battery of tests was administered pre- and posttraining to document the 
imoa« of ?he program on the attitudes ahd values of participants. The spe- 
cific purpose (educational objective) for each instrument was made explicit. 
^pendL S describes each test and its measurement purpose. Many of these 

Questionnaire , tHp Minnesota T eacher Attitude Inventory, and The Persona^ 
O^entaokj nyi W^ will be ret ained for at least one year '"O". These may 
bl^eful in the futu re for research purposes and to validate selection 
procedures. 

if 

, Independent Audit of I nternship Evaluation 

Because internship evaluation personnel are also members of Mark Tw^^" School 
Bt^T an external evaluation to assess the appropriateness of evaluation 
procedure w^ i^l^ented at the end of the 1972-73 program Y^r. Dr. Malcolm 
ro^^rrirrtor-^of the Evaluation Research Center University o^y^^^^l^.^ 

^-Xe^rfr-^^^^ — - - 

the funding agency and to Montgomery County Public Schools. 

The independent auditor found the evaluation design "both comprehensive and 
tnr.rnallv consistent.'"' He commented on the provision by evaluators to the 
inarruciional stafrof accurate and timely information for use in program 
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modification and as growth records of trainee P«'«-'»«»^;- ^ nllirAfXuB 

deter-ina Int.m co»p.t«»cie» through «.aaur«ant was ^"J 

than those found In aliiost any university setting ani it quUlfies along with 

a very few coapetency-baaed programs In the country as a rigorous and 

;et:2dned ^^rt to'both n^asure and i^rova a "Jf i^^^J'^f 

The objective of assessing faculty qualifications was Judged as least well met 

by evaluation techniques and procedures. 

Discussion and RecooBeflidations 

Aa was stated in the Mark Twain Tea c her Internship Program Evaluation Report for 
1972-73. 

' "The ideal criterion against which teacher competency might be 

appraised consist, of a systematic analysis of the level of outcomes 
achieved by the teacher with pupils he teaches over relatively long 
periods of time (at least two' years). According to Rosner (1972). 
demonstration of change in teacher competency under actual class- ' 
room conditions Is the most appropriate level for accountability in 
teacher education. Teacher education, howtever. does not yet possess 
the necessary instruments to measure change in specific competencies 
(Rosner). Assessment of teacher competency under actual classroom 
conditions, where it is attempted, is reduced to the use of an 
observation system (e.g.. Flanders) or. as in this case, the use of 
rating scales. The following steps can be taken to i»P"y«^ J^* ^. _ 
reliability and validity of rating procedures : more explicit atate 
^iifof dJarred behavior, criteria to Judge the presence or absence 
of that behavior, and the training of personnel used as raters. 
(MCPS. 1972. page 37) 

Ti.^ nreaent state of instrumentation for classroom observation cootinuep to hamper 

di?ions is n>ore advanced. Although some degree i^"' ^« ;,«"e 

J 4« r.r^^4^*>r^^ ovor nosslble randoiD variation in ail aspects oi tne 
^llZtlll "?Serefore to increase feUabUity. both methodologies should be used. 
?ie deiei;paJ^t of a iiSted number of quality assessment techniques independent 
^ ^7tll7tZl and appropriate to broad competency level objectives remains . 
major goal. . 

The procedures and techniques used for evalition of intern P^S""/?;'"?^"'^ 
'XlllX acquisition of ^Ptcific .kills a^^^^^^^^^ 

statements of performance behavioral f J^««p;^,J^,e Objectives and all 
seminar performance ratings, relating to 35 Qt <n aources was relied 

15 competencies, contributed to these evaluations. ^J^i^^f °^ '°"i"%Xn by 
«n f-o balance lack of precision in instrumentation. A major step was WKen oy 

Zitiattr^JZ\o balance both simulated and actual J^f "'..^^'^"'^iie 

initiating a mov practicum verification packet #or B.O.A. 1.3(c) is the 

°Lh'p^icedure 5eJ;ioJe;! others will follow during 1974-75 for other clearly 

In addition, practicum coordinators are instituting training in , 
' ^^'k!- J^^tlluaaon Form for practicum supervisors during "ientat o^ 
' r efere^e list of illustr ative activities has been developed to guide 
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Comnarison of the pre- posttest battery results for 1972-73 and 1973-74 shows a 

n^er of signifJcant changes in the direction predicted in the valued 
att?tudrof the la?^er group. While it is recognized that the variables 
measured are poorly defined, the error of measurement large, and the size of the 
TZTe sZllresJlts were promising enough with the most recent B^Juat- ° , 
:^ort continuing the testing with the modifications noted above Combination 
lil a pre- posttest of basic knowledge in general and special f.^^.y 
orove fruitful. It must be noted again that the program deals with a carefully 
selecterpopulation of successful, experienced, and "^f 
J^realistL to look for significant positive changes in the ^^^^^y high levels 
^ the valued attitudes. Changes in cognitive levels are more easilf^ prte- 
cisely measurable. 

To increase the effectiveness of the assessment of changes in knowledge, attitudes, 
and skills of program participants, it is recommended that: 

A test of basic knowledge in general and special education be a^d^ to the 
pre- posttest battery. 

Techniques for assessment of intern acquisition of specific skills and 
knowledge be submitted for evaluation of methodology prior to use. 

Development of verification techniques for use in natural settings be c8n- 
tlnued and accelerated. 

Implementation of competency- level assessment independent of instruction be 
emphasized. 

OBJECTIVE 6 

Program Objective. To increase the number of trained personnel serving handicapped 
children. 

Evaluation Obiective. To determine if personnel completing the training program 
arfe?^ec?ively serving emotionally handicapped children and are utilizing learned 
competencies . 

Evidence ^Toward Attainment of Objective 6 

A. Graduates of the 1971-72 Mark Twain St a ff Development Institute 

Prior to the opening of Mark Twain School, the teaching staff completed the 
sJx!mon?h draining program which was the forerunner of the Mark Twain Jeacher 
Internship Program. They received supplementary certification as special 
edicrioi'teachers. For.the 1973-74 school year, 32 of the "i^i-^ 
members continued in Mark ^.ain Programs. Three were on leave further 
their education, two of whom were acquiring advanced degrees in special educa 
tion O^e «»ved from the area but was still employed in special education, 
^d InotJer was employed as a 10-»onth regular classroom teacher For the 
107A-75 school year, 32 of the original 37 staff, members continue in Mark 
iwain programs. Tw;nty-six are in administrative or teaching positions in 
M^rk T^ain School. Six, including the two who were on academic leave last 
Te^XTe m^ved into M;rk Twain School-Based Programs. One is on maternity 
leave, and one has returned to a regular MCPS school- 
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\, Graduatea of the 1972-73 Teacher I nternahlp Prograa 

Sevei» of the eight intema^ccepted Jobs in Hark Twain Prograw af tar gradua- 
tion. They reaain in their positions (though one has changed achoola) far 
the 1974-75 school year, one in Mark TWain School, and six in Mark Twain 
School-Based Prograas. At the end of their first year of teaching troubled 
children, the graduates were Wed to evaluate their effetetivMiess at using 
their learned competencies; their principals or supervisors were asked for the 
sane ratings (Appendix G) . Median ratings by graduates on the 15 coapeteacee 
ranged from 4.0 to 5.0 on the 5-point scale; median ratings by principals 
ranged from 3.5 to 5.0. The supervisors rated the graduates' performance only 
slightly lower than the graduates rated themselves In the competencies related 
to completioli of a psychosducational profile, use of behavior intervention 
techniques, ^d use of the consultation process. 

C. Graduates of the 1973-74 Teacher Internship Program ^ 

All eight interns successfully completed the program and received supplementary 
certification as special education teachers. Seven accepted eaployaent for 
1974-75 in Mark Twain Programs; three as teachers in Mark Twain School and , 
four as student resource teachers in Mark Twain School-Based Programs. The 
eighth graduate la in a MCPS elementary school teaching a class of learning 
disabled children. 

D. Participation in Mark Twain In-S ervice Courses 

The internship seminar courses in the fall of 1973 were opened to all 
interested staff of Mark Twain Programs in addition to the eight interns. 
Courses were repeated during the spring of 1974 with all Interested MCTS 
staff, in addition to Mark Twain Programs staff., invited to enroll. Three 
in-service credits were awarded for successful completion of each course. 
Table 9 shows enrollment in both tTie fall and the spring series of Mark TValn 
seminar courses. 

Apart from regular internship course enrollment, other means were used to 
spread Mark Twain training through MCPS. Workshops were conducted by intern- 
ship instructors for the faculties of one secondary and /J^f "J"^' 
schools. In addition, a composite course to run 15 weeks (with instruction 
for three weeks in each of the five learning areas) has been developed for 
the faculty of a MCPS junior high school at the request of its principal and 
staff This will be given during the fall of 1974 and has been approved for 
three' in-service credits for successful completion. It has been designated as 
"Mr-07: Improving Skills for Teaching Adolescents With Special Needs and is 
intended for regular classroom teachers. 

Discussion and Reconoendations 

Review of the employr.ant record of Mark Twain trainees indicates that the objective 
i^^reLing. Z n\Ler of teachers effectively serving emotionally handicapped ^ 
dren is being met. Graduates of the original Mark Twain Staff Development 
xltute and of the Mark T^ain Teacher Internship Programs continue as JPecial 
^Jcators; ratings by their supervisors of their performance on the job 1- strong 
Evidence of their effectiveness. 




